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ABSTRACT 


This thesis investigates the interfacing of voice recog- 
nition, also known as automatic speech recognition (ASR), 
with the Joint Interoperability of Tactical Command and 
- Control Systems (JINTACCS) Automated Message Preparation 
System (JAMPS). The voice recognition system we used is the 
Texas Instruments (TI) TI-SPEECH( tm) imbedded in the TI 
Portable Professional Computer (PPC). We were able to load 
the JAMPS software onto the TIPPC's hard disk. With the 
vocabulary we built, we ran the JAMPS software on the TIPPC 
using voice recognition. Our results indicate ASR has an 
application in message preparation during military opera- 
tions. ASR could curtail the time to prepare messages, and 
thereby reduce the time element in the command and control 
process. We propose a measure of performance to test how 
much time might be saved by using ASR with JAMPS. We also 
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I. INTRODUCTION 


In the last 5 to 10 years, the United States has 
increased the emphasis of the command and control (C2) 
process in military operations. For example, Dr. Joel 5. 
Lawson, Sr., has proposed some informative models of the C2 
process in his report, "The State Variables of a Command 
Control System." [Ref. 1: pp 93-96] If the U.S. military 
can SENSE the battlefield situation, PROCESS the sensed 
inputs to derive intelligence, COMPARE the processed infor- 
mation with the desired situation, DECIDE on a course of 
action, and then ACT more quickly than the enemy can do the 
SENSE-PROCESS-COMPARE=}DECIDE-ACT process, then we can 
outfight the enemy. The idea is to have "effective" C2 so we 
can "beat the enemy to the punch." Within this C2 process, 
time is a critical element. 

To get a common understanding before going further, 
let's look at the Department of Defense definition of 


command and control: [Ref. 2: p. 74] 


(C2) 1s the exercise of authority and direction by a 
ep cleke so designated commander over assigned forces in 
he accomplishment of the mission. Command and control. 
functions are performed through an arrangement of 
personnel, equipment, communications, facilities, and 
procedures whic are employed by a commander in plan- 
Pie cere cC Ling, coordinating anGweenErelmlrag LOrces 
and operations in the accomplishment of the mission. 


Looking at C2 in amore general view, it is the means by 
which a commander gets information about the situation which 
confronts him, how he reaches a decision in responding to 
the situation, and how his directions are communicated to 
his subordinates. 

There are many projects designed to improve our C2 


system. One such program is the Joint Interoperability of 


Tactical Command and Control Systems (JINTACCS) Automated 
Message Preparation System (JAMPS). JINTACCS was’) estab- 
lished by the Joint Chiefs of Staff (JCS) so the military 
services would have common standards for communicating 
information during joint operations. JAMPS is the software 
to automate the preparation of these JINTACCS-standardized 
messages, thereby reducing some time elements in the C2 
process. This thesis will look at the feasibility of 
improving the man-machine interaction by using voice recog- 
nition as an input medium for portions of JAMPS. Our 
specific goal is to integrate the voice recognition capa- 
bility of the Texas Instruments Portable Professional 
Computer (equipped with TI-SPEECH(tm))+ with the JAMPS soft- 
ware. We hope to relieve the operator from some of the 
mundane work associated with keyboard entry, focus his 
attention more on the message information, and thereby 
reduce the time element within the C2 process. In this paper 
we also suggest a measure of performance to test how much 
time might be saved by using voice recognition as an input 
method. Although the performance measure compares the manual 
method of preparing hard copy message traffic to the auto- 
mated method (JAMPS), it can still be used to compare JAMPS 
to JAMPS with voice input. We conclude the thesis with our 


results and recommended areas for further research. 


(Note: When we first started this research, we had hoped to 
interface the TI Portable Professional Computer and its 
imbedded TI-SPEECH card with the JAMPS II.V prototype hard- 
ware. However, toward the end of our thesis work, the JAMPS 
software had been upgraded so it could run on microcom- 
puters. such as the IBM PC-XT and IBM compatibles. This 
provided us with a different approach and an interesting 


result; the JAMPS software could run on the TI Portable 


1TI-SPEECH is a trademark of Texas Instruments, Inc. 


We. 


Professional Computer. This made the integration of voice 


recognition somewhat easier). 


aaa 


II. JINTIACCS AND JAMPS 


A. JINTACCS (JOINT INTEROPERABILITY OF TACTICAL CZ Sista 
The basic goal of the JINTACCS Program is to develop 
plans to achieve compatibility and interoperability of the 


military's command and control (C2) systems in joint air, 


gEouney and amphibious operations [Ref. 3: De Bis) ie 
Specifically, the JINTACCS Program Office in Washington, D. 
Cee is responsible for developing standardized message 


formats and procedural interfaces between tactical C2 
systems in joint/combined operations [Ref. 4: p. 37]. The 
program waS a necessary response to the problems’ the U.S. 
military faced when trying to operate together with the 
various tactical C2 elements having their own equipment, 
procedures, and standards. 

JINTACCS had ‘its origins back in April, 1971, when the 
JCS established the program Joint Interoperability for 
Tactical C2 Systems in Support of Ground and Amphibious 
Military Operations (GAMO for short) [Ref. 5: p. 2]. GAMO's 
objective was to ensure interoperability and operational 
effectiveness of tactical C2 systems used to support ground 
and amphibious operations. The GAMO Program discussed the 
development of character oriented messages (COM) standards. 
COMSs are messages which are human readable, yet can be 
processed by machines. A new acronym used in place of COMs 
is message text formats (MTFs). In this paper, COMs will be 
a generic reference to messages which people can read, while 
MTFs will pertain strictly to JINTACCS message standards/ 
formats. 


GAMO also picked up the responsibility for developing 


bit oriented messages (BOM) standards [Ref. 5: p. 2]. BOMs 
are ideal for machine processing, but require some form of 
translation for people to read. BOM standards are commonly 
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known as tactical digital information link (TADIL) stan- 
dards. Since JAMPS does not deal with BOMs, no more will be 
said in this thesis about BOMs. 

With the issuance of JCS Memorandum SM-184-78 in 1978, 
the JCS reorganized the GAMO Program [Ref. 5: p. 4]. The 
program name was changed to JINTACCS. Although the program's 
objectives remained essentially the same, the JINTACCS 
program now had more authority in order to achieve the 
interoperability of tactical C2 systems. JINTACCS does not 
specify message standards for each service's internal proce- 
dures, but rather the message procedures and standards of 
services involved in joint operations [Ref. 6: p. 56]. With 
its reorganization and tasking for proven results by 1985, 
the JINTACCS program set up a plan to develop, test, and 
demonstrate these message formats and procedural interfaces. 

The most recent change for the JINTACCS Program Office 
occurred 5 July 1984. This is when the Department of Defense 
formally established the Joint Tactical Command, Control and 
Communications Agency (JTC3A) at Fort Monmouth, New Jersey. 
The JEC3AYS Mission is to [Ref. 7» foreword] | 


Chiotmeceene “interoperability of tactical . .. Pen OCSe 
systems for Srnec Oreconeried, Operations . . yee eye 
accomplishes this through the development and mainte- 
nance of a joint architecture, interface standards and 
he eee efinitions fol | Cacieke sl sand mobile C3 
systems. 


With its formation, the JTC3A now had responsibility for the 
JINTACCS Program as well as many other C2 related programs. 
Yet the JINTACCS objectives remained the same. 

So for a quick recap and without regard to the BOM 


(1. eam TADIL) standards, the specific purposes of the 
JINTACCS MTFs are [Ref. 8: p. 1-3] 
° rovide same message formats for all services in order 


oO exchange tactical information between operational 
facilities; 


* provide messages which computers can process; 


* provide messages which people can read. 


HES 


Jigs Message Text Formats 





COMs are record message traffic. The usual procedure 
to send COMs is for someone to type on a DD Form 173 
(Standard Message Form) or to type or handwrite on a Joint 
Message Form, then bring it to a communications center for 
processing and transmission. (Thistpaper Oni ere re renecc. 
the Joint Message Form). As mentioned earlier, the JINTACCS 
requirement is for MTFs to be machine processed and human 
readable. This need is especially important when consid- 
ering fully automated C2 systems. The MTFs will be read by 
people and will also be used to automatically update data 
bases or reformat messages for further transmission. 


JINTACCS message standards now encompass strictly formatted 


messages for five JINTACCS functional segments: intelli- 
gence, air operations, fire support, maritime operations, 
and operations control [Ref. 3: p. 7]. Presently there are 


about 135 standardized messages for these 5 segments. At the 
time of this writing, the JTC3A's JINTACCS Program Office 
was making plans to include a sixth functional segment, 
combat service support [Ref. 7: pp. 5-6]. Implementation of 
this segment is expected in 1989 and should add about 60 
more MIFs. JTC3A is also incorporating a seventh segment for 
special operations [Ref. 9: p. S3])5) 
2. Message Composition 

JINTACCS messages, like all messages, have a 
heading, text, and ending, as shown in Figure 2.1 [Ref. 8: 
p. 1-3]. The heading contains the addressing and routing 
information for the message. The text is the body of the 
message. Both the heading and ending formats depend on the 
communications system being used. 

The text of JINTACCS messages consists of two basic 
elements: the set and the field. Fields make up sets. There 
are also several categories of sets, which are shown in 
Figure 2.2 [Ref. 8: pp. 1-4 to 1-5]. 
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VZCZCVTA002 
PATCZYUV RUSAACM008 268 1609-CCCC--RUSAATA RUSAATB 
ZNY CCCC 
P 2516302 SEP 82 
FM COR I! CORPS//RUSAACN// 
TO RUSAATA/COR 6TH INF DIV//SAATB// 
RUSAATB/CDR 10TH INF DIV//SAATB// 
BT 
CONFIDENTIAL 
EXER/BOLD PUSH 82// 
MSGID/PLANORDCHG/I! CORPS/2609001/SEP// 
PLANORD/PLNMNO:II CORPS 1602/-/-/-/-/-/PARANO:3A// 
AMPN/CHANGE TO: 6TH INF DIV INITIALLY IN CORPS RESERVE. FOLLOWS 
1OTH INF DIV ON AXIS SWORD. AFTER 10TH INF DIV SECURES OBJ 
BLUE, BE PREPARED TO ATTACK THROUGH 10TH INF DIV TO SECURE 
OBJ GREEN// 
AKNLOG/Y// 
DECL/OADR// 


UNCLASSIFIED SAMPLE 





Bagqure 2. 1 Message Components 


SET is the basic building block of all  JINTACCS 
Neeeeigcemewicet is Similar to a sentence and has infor- 
mation about one subject. 


Peo neeDbacic DUiicwng galock ‘of the set. You can 
ri of the field as a word within the sentence, the 
set. 


LINEAR SET 1s a group of fields ina line across the 
page. 


COU wohl 1S sea,gqroup ©f fields arranged in columns 
(le tabular Rosine 


Poole ont 1S a set entered in lines, columns, 
Seieemeas Or Paragraphs. Free text sets provide infor- 
mation which does not fit into other types of sets. 


Peo Nae S aabame to —hnelp you recognize the set 
or field. The name telis you what is in the set/field. 
In columnar sets, the name is sometimes referred to as 
columnar headers. 


she 


V2CZ2CVTA002 
OATCZYUV RUSJTFD0008 268 1609-CCCC—RUSAATA 
ZNY CCCCC 
O 251630Z SEP 82 
FM COMUS UTF 21//WNGRA// 
TO RUSAATA/CDR Ht CORPS//RTYSM// 
BT 
CONFIDENTIAL 
EXER/SWIFT STRIKE 82// 4 


/MILOTM = /QTY /TGTTYP /EQNT ./SP0 /DIR /LGTH 

/T-72 / 4QOMPH/N / OK 

/2509002Z/ 18 /ARTYSM /D1I-M1973/ 3OMPH/NE / 18K 

/03/FAO21D /- 1/10 /- /- / -/- / 800K 


/DE/LOCATION JETA 
/01/32TMV 12341234 /2516062 
/02/32TNV 12341234 /2517002 
/03/300845N0204005E// 
DECL/OADR// 


UNCLASSIFIED SAMPLE 


(1) 


FIELD 
LINEAR SET 
COLUMNAR SET 


FREE TEXT SET 





Figure. Zaz Message Text Components 


Sets and fields have usage categories (such as 
mandatory, conditional, optional, and repeatable) which tell 
the JAMPS operator if the set or field must or can be used 
in a message, or if it can be used more than once. This 
information will appear at the bottom of the video display 
as the system user is filling out message templates. 
Conditional means the operator does or does not have _ to 
complete a field depending on whether he did or did not 


complete a previous field. 


We 


3. Formatting Rules for JINTACCS Messages 
There are general rules which govern the input of 





information into the fields and sets of JINTACCS messages. 
[Ref. 8: pp. 2=3 to 2-5] 

e The allowable characters for input are 
i Te all 


blank spaces; | 
special characters . ,: ()?¢e#/Y/. 


e The slant bar (/) is a beginning-of-field marker and 
should not be used for anything else in linear or 
columnar sets. 

¢* The double slant bar (//) indicates the end of a field. 
It acts as a period in a sentence. The slant bars must 
be on the same line. 

¢e Do not split a field between lines. 

e You cannot enter more than 69 characters on a line. 

¢ The hyphen (-) is the no data sign. You_would use this 
when you must make some entry into a field or set, but 
you do not have the information. There are specific 
rules guiding the entries into mandatory sets- and 
fields, and conditional and optional fields. 

e The special characters which are NOT ALLOWED IN 
JINTACCS MESSAGES are ! ; "@# %S$ & * + = and the 


degrees s Ok Operators should take Bpecte* care not 
to include these symbols in free text sets. 


4. Adopting JINTACCS Standards 

A series of tests and demonstrations of the new 
emessage Seandardswhavew taken place from 1981 through 1985. 
SOLID SHIELD '85 was the last operational effectiveness 
demonstration (OED) of the MTF standards before implementa- 
tion. The JCS has mandated that the JINTACCS-developed MTF 
standards for the first five functional segments will be 
implemented by 30 September 1986. The services will use them 


in any joint service operation thereafter. 


le 


B. JAMPS OVERVIEW 

Early testing (to include the 1981 JINDACCS OED) of 
formatted messages using JINTACCS standards showed some form 
of automation would be necessary [Ref. 10: p. 2-1]. The 
messages were difficult to manually prepare and often full 
of errors. This problem led to timeliness requirements not 
being met for messages. Obviously word processing and auto- 
matic data processing could provide a solution. This is when 
the Air Force, along with the MITRE Corporation, developed 
the JINTACCS Automated Message Preparation System (JAMPS). 
The Air Force organizations included the Tactical Air Forces 
Interoperability Group (TAFIG) at Langley Air Force Base, 
Virginia, and Electronic Systems Division at Hanscom Air 
Force Base, Massachusetts. 

In developing the software, the JAMPS effort explored 
message preparation techniques, software/hardware inter- 
facing, configuration management, and the capabilities of 
JINTACCS standards [Ref. 6: p. 57]. The software uses data 
tables to select, prepare, store and retrieve, review, 
transmit, and receive JINTACCS-formatted messages (i. e., 
MTEs). The JAMPS software is designed to make message rules 
and formats as transparent as possible to the operators 
during the operational effectiveness demonstrations [Ref. 6: 
oil ie This is a crucial design feature considering the 
complexity of the JINTACCS standards. 

1. JAMPS Beginning 

The origin of JAMPS coincided with a MITRE 
Corporation project to support the JINTACCS Program. ~ Mire 





had created the message encoding/decoding technique called 
Interoperability Through Structured Message Exchange (ITSME) 
[Ref. 3: p. 6]. MITRE upgraded ITSME and gave it to the Air 
Force as JAMPS, later to become JAMPS I. JAMPS I software is 
written in "C" programming language under the UNIX operating 


system and runs on the PDP 11/70 mainframe computer. JAMPS I 
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also uses Perkins-Elmer OWL 1200 display terminals. After 
many enhancements and installation of the software onto 
portable hardware, JAMPS I became JAMPS II. 
Ze JAMPS II1 Hardware 
The new hardware for JAMPS II was based on the 
Digital Equipment Corporation (DEC) LSI-11/23 microprocessor 
with 256 kilobytes of random access memory (RAM) [Ref. 3: p. 
27). Other hardware features include [Ref. 11: pp. 12-13] 
pee seers cas) sot a).,220729,,conmtngtign Ai 
megabyte, 8 inch ffopoy psc iver oe ae -_— 
¢ a DEC VT103 video terminal with keyboard, display, and 
a card cage with the microprocessor, memory and periph- 
eral cards; 
¢ a DEC MSV11-LK 256 kilobyte RAM board; 
a BEC DEvVi-J 4-port RS<-23Z2emultiplexer; 
e a DEC DLV11-E asynchronous line interface; 
* a DSD 8832 interface board; 


° Phres empty dual-connector card slots with Q-bus inter- 
ace; 


¢ a Centronics 150-3 dot matrix printer; 


¢ abus interface unit (BIU) the Digital Communications 
Corporation (DCC) BIU Model 4024. 


So JAMPS II.V Hardware 

The latest prototype, JAMPS II.V, is a further 
upgrade from the previous JAMPS workstations. JAMPS is still 
Welceen in "Cc" Language and runs under the UNIX operating 
system. The upgrading replaced the JAMPS II microprocessor, 
RAM, and disk drives. JAMPS II.V now consists of a DEC VT103 
video terminal and a Cambridge Digital System (CDS) 94 
system.* This CDS 94 consists of 


¢* achassis (SIGMA SA-H102) with Q-bus backplane, 8 Quad 
slots, 22 bit addressing; 


¢ a Cadmus 9000 MC68010 microprocessor board; 


¢"JAMPS II.V Operator's Manual," eno Crp) lee This vlacst 
is an update to the present manual’s hardware list found in 
Appendix G 


1S, 


* a PCS 08512 512 kilobyte memory board (for RAM), which 
is dual-ported and expandable; 


* a DEC DLV11-J 4-port RS-232 interface board; 

* a DEC DLV11-E single-port full modem control board; 
* a DEC DZV11-M 4-port multiplexer board; 

* an Emulex SCO2/C Winchester controller board; 

¢ a SIGMA SDC=-RXV31 floppy controller board; 


e e aaa M2312 84 megabyte Winchester drive (hard 
isk); 


* a Tandon TM848 floppy drive (8 inch floppy disk); 
¢ Winchester disk bootstrap software; 
¢ diagnostic firmware. 

In addition to the above components, the JAMPS II.V 
workstation has a DCC BIU Model 4024, anda Datasec DSP=-225 
ink jet printer. The benefit of the JAMPS workstation 
upgrade from version II to II.V is a much improved response 


time. 


(Note: JAMPS II and II.V imply both hardware and software, 
whereas JAMPS, by itself, implies just the software. In a 
generic sense, JAMPS also refers to the concept of automated 
message preparation). 

4. JAMPS Software on Microcomputers 

As of the date of this writing, TAFIG and MITRE had 

just finished upgrading JAMPS to run on microcomputers. 
JAMPS software can now run on International Business 
Machines (IBM) PC-XT microcomputers and IBM compatibles, 
such as the Zenith 2-150. This seems a logical and necessary 
path to follow since desktop computers are in widespread use 
in the military. 

oye Features and Capabilities 


JAMPS provides a variety of menus for available 


messages. The main menu provides the categories seen in 
Table 1 [Ref. 10: pp. 8-5]. (Note that combat service 
support and special operations do not appear). Within 


categories 2 through 6 there are over 130 message formats 


Z0 


within the data tables. Upon choosing the message type you 
want to send, you would be presented with a mask mode temp- 
late. This is a fill-in-the-blanks template of up to 20 
lines. Operators enter information into empty data fields 
by using the keyboard. Figure 2.3 is the mask mode template 
for an air base status (ABSTAT) report [Ref. 3: p. 13]. 


TABLE 1 
JAMPS MAIN MENU 


ADMIN 

AIR OPERATIONS 
OPS CONTROL 
INTEL 

Pen SUPPORE 
MARITIME 
Messages Saved 


Messages Transmitted 


i 
2 
S: 
: 
= 
6 
7 
8 
2, 


Messages Received 
MERGE FILES 


eke Quit *** 


te fu 
- © 





Should the operator want, JAMPS will display "map 
Characters" in the empty data fields where the cursor is 
located or "tabbed" to. The map characters show the allo- 
wable data types (such as numeric, alphabetic, blank, and 
special symbols) which go into the data field. The operator 
cannot proceed in filling out the message if he enters the 
wrong data types (i.e., entering a number in an alphabetic 
map character position). 

A HELP function is also available to assist the 


SpenatotminetyLling a field with data. The HELP function 
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INWO S3dQ3W1 BSWIL SdO SOd SASHY OSGAMY 3G/ 

153uy0B 
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Tn ean ee ee “o> ea (eee ee -- oe oS ne 
917 917 917 d¥DLM dWODAMY HLGM HL91 S3d3aW1 JWIi SdO YSGAMY 3G/ 
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ne ne Res OO ee ae ee OS Pe eee /NdWY 
a Tse: aaa Oo CS On Ayame <9 aes Ola /) eee oe, Sea 

Peer 2CGadO7 —> ==ae 0U1/ soot es 235ua/ 77 :3qa/1¥1S39SV3 

J/ -=77 30090SI1SYN/ =" SYLONDSdS/ 7777 TT SONYSS/ Wren ve SILAVQTIW/ 
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Ae ae a re ee gS ee /NdWV 
y/o 7 = GOISISUN =o >¥yLOND3dS/ 

es aaa NGG? eawe as (I LAUGHIR,. 0 See ono 

a pn ec SSdAL9NSW/ ~ 2[YsLGI7WsS/4534 

 /) ae ONT eee 1 ee NEN ee SONNSS/ 

ae So oe SYLUNIOIYO/S L¥LS8Y 23dALNSW/GIYSW 


B/704 Mask Mode Template 
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displays, for the field the cursor is in, a screen of infor- 
mation concerning that field. The operator can fill out an 
entire message using just the HELP displays by entering the 
"conversation mode." [Ref. 12: p. 5] In conversation mode, 
fields are presented one at a time as part of the HELP func- 
tion. When the operator finishes with the current field and 
pushes the TAB key, the next field is shown ina HELP 
display. At any time the operator may revert to mask mode. 
The operator can edit the message very easily since the 
JAMPS software has many of the common word processing 
features. Editing includes calling in additional data 
fields. These modified message formats can then be stored 
for later recall. 

The operator can review a message he is preparing by 


' Review mode deletes unused data 


entering the "review mode. ' 
fields and trailing blanks. This also happens when the oper- 
ator transmits a message. While in review mode, the system 
user may hit a VALIDATE key to make JAMPS check the message 
for data-sequencing errors. These types of errors are viola- 
tions of certain JINTACCS formatting rules and occur when 
the user has failed to complete a mandatory data field or 
set. 

As depicted in Figure 2.4, Teormacion about 
JINTACCS message formats resides in data tables external to 
the program code [Refs. 3,6: pp. 19, 57]. This provides two 
advantages. First, the cost of changing message formats will 
be reduced. Second, other C2 software programs can access 
the same data tables. This capability will make the remote 
updating of JINTACCS standards much easier. These external 
data tables will give tactical commanders and communicators 
the ability to deal with information exchange needs not 
originally foreseen by JINTACCS architects [Ref. 10: p. 
2 = 2d Figure 2.5 outlines the JAMPS software architecture 
PRefetoemep. 21); 
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KEYBOARD PRINTER 


~- MESSAGE ~ RECEIVE MESSAGES 
PREPARATION REQUESTS - TRANSMIT MESSAGES 


~ OPERATOR DATA ENTRY JAMPS - REVIEW HARDCOPY 


APPLICATION 
TACTICAL COMMS 
PROGRAMS we 
- 20 MILLIAMP 
- AUTOOIN 


JAMPS DATA TABLES 


MASS STORAGE 
= SAVED, 
~ RECEIVED, 
- TRANSMITTED 
- MESSAGE OESCRIPTIONS MESSAGES 
- DATA POINTERS 
- HELPTEXT, CODES 
(BUILT FROM TECHNICAL 
INTERFACE DESIGN PLAN, 
MESSAGE ELEMENT DICTIONARY) 





Figure 2.4 Table Driven Software 


JAMPS is compatible with an encode/decode scheme 
which will let dissimilar systems exchange and process 
JINTACCS messages, even if these systems are tuned to 
different message versions of JINTACCS [Ref. 10: p. 3-1]. 
This is true in Europe, where some teletype messages may 
take more than 12 hours to reach their destination because 
of the number of manual store-and-forward switches. Even if 


all C2 facilities updated message standards at the same~- 
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pagure 2. 5 JAMPS Software Architecture 


time, there would still be some lag time in which two 
different versions of standards were in effect. JAMPS could 
accomodate these multiple editions during the transition. 
The encode/decode methodology further expedites message 
transfer by compressing (or "packing") the message 30 to 50 
percent before transmission, and "unpacking" it at the 
receiving end. 

There are actually two sets of external data tables. 
One set is the master set, while the other set, a draft set, 
is a machine-efficient derivative [Ref. 10: p. 3-1]. Should 
the draft files be accidentally destroyed, then JAMPS auto- 


matically regenerates new draft files. 
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MESSAGE HEADER LINES ADDRESSING LINES 


VZCZCBAAOO 1 

OTTUZYUW RUTACCAOO001 2112300-UUUU—RUFDASE RUVENCV. 

ZNR UUUUU 

O P 301622Z JUL 81 

FM RUTACCA/HQ TAC LANGLEY AF8 VA 23661 

TO RUFDASE/475TH SPEC SERVICES SQ MACDILL AFB FL 

INFO RUVENCV/23RD TAC CON WING (SIM) DYESS AFB TX 

BT 

UNCLAS/EXCLUSIVE// 

SIC TCQ// 

EXER/NOVEL VENTURE/ORANGE// 

MSGID/APORALOT/TAC /ADFSQ/2110001/JUL/PER/007// 
REF/APORALOT/TAC /ADFSQ-PR /301123G/JUL/2 11000 1/TCQ/NOTAL// 
CANX/SITREP/TAC /ADFSW-PR/2093023/01// 

PERID/3 10000G/3124006// 

APPOR/SHERRY/PG/ASW/999K// 

6ALOT 

/LOSE GAIN AMSN NOAC ACTYP ACUNTIO ICAO 
/FORCE ALPHA TENAFLY ASW 3 AVBB BANDIT 4. VFSA 
/TINKER TOY - WwW 2 FBJ ROCKER -// 
TGTPRI/AMSN:ASW/ 1 2AEDAAAFAAA// 

AKNLOG/Y// 

RMKS/IGNORE THE ABOVE. THIS IS A TEST MESSAGE // 

BT 

0001 


UNCLASSIFIED SAMPLE 


SENDERS MESSAGE NUMBER (0001), BODY OF MESSAGE, 
PLUS PAGE SPACE-UPS AND END MARK LE. “LINE 12° IN 
(WHICH ARE TRANSMITTED) JANAP 128(H) 





Figure 2.6 Message Printed in Transmission Format 


The JAMPS software needs message header and trailer 
information to transmit the JINTACCS message. See Figure 2.6 
for an example of a message in transmission format [Ref. 12: 
Dereo7 |. The message header contains addressing and routing 
information. Separate addressing lines also contain FROM, 
TO, and INFO addressees. THIS informacion must cConformneare 


the rules in the Joint Army, Navy, Air Force Publication 


20 


( JANAP ) Automated Digital Network (AUTODIN) Operating 
Procedures (JANAP-128(H)) to allow transmission over mili- 
tary communications systems. A JINTACCS message actually 
becomes the main body of a JANAP 128(H) message. In partic- 
ular it will be in AUTODIN PLAINDRESS message form whereby, 
the addressing information is sent in the clear, even if the 
body of the message is encrypted [Ref. 12: p. 4]. Like the 
JINTACCS data tables, there are JANAP data tables which the 
applications program can access for the addressing and 
routing information. Once the operator hits the transmit key 
for the JINTACCS message, JANAP 128(H) headers and trailers 
are added and the message then goes into the AUTODIN 
emrcumcs |Ref. ll: p. 28). 

JAMPS interfaces with the AUTODIN communications 
system by AUTODIN Mode I or Mode II. Mode I is a highly 
automated protocol which does the interfacing between 
AUTODIN and the JAMPS workstation. Mode II is a manual 
interface needing much more operator involvement. Finally, 
after the JINTACCS message receives the JANAP header and 
trailer information from the stored tables, the message is 
printed out on a line printer, converted from American 
Standard Code for Information Interchange (ASCII) to 5-level 
Baudot, then transmitted over external communications links 
PRCfer: Da 28). JAMPS automatically Keeps a copy of the 
transmitted message for future reference, retransmission, or 
change. 

When the JAMPS workstation receives a message, the 
message is automatically printed out and stored; and the 
JAMPS workstation alerts the operator to the message's 
Sem aieerer. ill: p. 15]. Once the JAMPS system has stored 
the message, then the operator may review, EepniInc, Or 
delete the message. The received message, like a transmitted 
message, is in 5-level Baudot code. The Baudot code is then 
converted to ASCII. 
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JAMPS workstations are compatible with the AN/TYC-39 
message switch. The AN/TYC-39 is a 25 or 50-line tactical, 
automatic store-and-forward message switch for record (hard 
copy) communications [Ref. 13: pp. 448-449]. This message 
switch directs the message traffic in its tactical network. 
It features automatic access and tandem message processing, 
automatic message protection and management, and traffic 
segregation. The AN/TYC-39 message switch is already opera- 
tional in Europe. 

JAMPS II.V workstations can be configured for a 
variety of operations, depending on the tactical C2 environ- 
ment. The various configurations are listed below. 
[Ref. 10: pp. 3-2 to 3-3] 


€ Single workstation not connected to a communications 


link. Draft messages, when approved for release, would 
be hand-carried to a communications center for trans- 
mission. 


e Multiple workstations not linked together or to _a 
communications link. Draft messages, once approved for 
release, would be hand-carried to a communications 
Center for transmis ome 


¢ Single workstation connected to a communications link. 


e Multiple workstations with one station connected toa 
communications link. Workstations would produce draft 
messages and save a copy on a diskette. If the megcage 
is appEc ves for release, the diskette will be brought 

to e workstation connected to the communications 

gateway for transmission. 


e Multiple workstations networked together with_ one 
Stat Lome ome aac ee. a communications J] vrai 
Workstations can forward "mail," messages, or portions 
of messages to the gateway workstation. This PoCal aumed 
network can accomodate Up sce three Cempurers Wali. 
acting as a central node and the point of entry to the 
commun cations ‘chante ws: Fach of the three computers 
can host up to six workstations. 


As you can see from these various configurations, there 1s 
much flexibility and responsiveness in using the JAMPS II.V. 
The workstation arrangements would depend on hardware avail- 


ability, commander's needs, and the tactical C2 environment. 
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Cc. JAMeS IN REVIEW 

JAMPS is a system of hardware and software designed for 
military personnel in sending tactical communications during 
joint operations. The JINTACCS Program has explored the use 
of common message standards for the military services in 
joint tactical operations. The JINTACCS Automated Message 


Preparation System has tested the concept of automating the 


more than 130 JINTACCS messages. JAMPS II andII.V are 
portable computers with the JAMPS software and the necessary 
input/foutput and storage devices. Just a few of the main 


features that help the operator prepare messages are fill- 
in-the-blank message templates; HELP menus; and message 
review, storage and retrieval. Military forces can link 
together JAMPS workstations ina local area network and 
interface with external military communications systems. 
The JAMPS developers designed the system with people in mind 
so they made JINTACCS message rules and formats as trans- 
parent as possible to the system user. 

The next chapter will look at voice recognition in 
general. The fourth chapter will explain the TI=-SPEECH ASR 
system. | 
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III. SPEECH RECOGNITION 


As stated in a 1984 article by George M. White, speech 
recognition is definitely an idea whose time is coming 
[Ref. 14: p. 213]. Speaking to one's computer may seem an 
unusual concept; but, as automatic speech recognition (ASR) 
technology improves and becomes more affordable, it will be 
as natural a method of input to a computer as the keyboard 
is now. ASR is generally thought to be the most difficult 
and complex problem to solve in the area of voice 
processing. Other aspects of voice processing, including 
voice synthesis, analysis, and encryption, are more easily 
defined and treated. ASR includes aspects of these fields 
and is therefore far more difficult to bound and solve its 
problems. Many large companies, universities, and the 
Department of Defense have devoted a great deal of energy to 
ASR research. The progress has not been as rapid as hoped 
for, but it has been steady. Because of the wide range of 
disciplines involved and the time already spent on the chal- 
lenges of ASR, progress should be considered evolutionary, 
not revolutionary |Retael4 pee Zee 

This chapter will provide general background on ASR 
technology as it now exists. Brief discussions will address 
the differences between discrete and continuous’ speech 
recognition systems and between speaker dependent and inde- 
pendent systems. One section will cover some of the voice 
recognition systems available at the Naval Postgraduate 
School. Another section will review some pertinent studies 
also done at this school. This information provides agiice 
of references should someone wish to do further studies 
related to this thesis. 
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A. TYPES OF SPEECH RECOGNITION SYSTEMS 

Studies have shown that the development of a voice- 
interactive system, as seen in Figure 3.1l1(a) [Ref. 15:  p. 
37], must consider the entire system and not just the speech 


component. 


SPEECH 
INPUT/OUTPUT Lg MACHINE 
SPEECH SUBSYSTEM 


VOICE INTERACTIVE SYSTEM 


SPEECH 


INPUT 3 MACHINE 
SUBSYSTEM : 





Proune=s. 1 Voice Interactive and Recognition Systems 


The voice interactive system is a man-machine interac- 
tion between a person and a speech input/output (1/0) 


subsystem. The I/O subsystem includes either ASR or speech 


ord. 


synthesis or both. This thesis concerns only the ASR portion 
(i.e., input mechanism) of the I/O subsystem and not the 
speech synthesis (output). Figure 3.1(b) depicts the voice 
recognition system we are dealing with. A thorough under- 
standing of the human, his tasks, and the interface tasks 
done by the ASR component will establish the need and advis- 
ability of interjecting speech into the system. Lt. as 
possible voice input is not appropriate to the application 
being considered. [Ref. 15: p. 37] 

If a system developer wants to incorporate ASR tech- 
nology, he will have several options to pursue concerning 
the types of ASR equipment. One can select between a 
discrete speech or a continuous speech recognition system. 
One can then choose a speaker dependent or speaker indepen- 
dent system. 

A discrete speech, . also called isolated utterances, 
system recognizes individual words or short phrases spoken 
with distinct pauses between words. This results in a 
stilted method of speaking that is not natural for a person. 
In a continuous voice recognition system, specific words or 
phrases are recognized by the system in the context of 
normal speech. The speaker talks as if in a conversation 
and without pauses to isolate the desired input. This mode 
of ASR is far more natural to the speaker than is’ the 
isolated utterances mode required by a discrete system. 

The next choice for the developer is speaker dependence 
or independence. This choice is based on factors such as 
the number of different speakers to use the speech system, 
training time available to new speakers, and the proposed 
use of the voice recognition system. For a speaker dependent 
system, the individual user must train the system with a 
finite vocabulary of words so it will recognize the speech 
input of that user. The size of the vocabulary depends on 


the manufacturer. Once a user has trained the system, his 
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voice patterns are saved and will be available to the user 


at any time. It is not necessary to retrain the system each 
time the person accesses the system. The user creates the 
vocabulary before training begins. Since the system is 


dependent upon the speaker, each vocabulary can be changed 
to meet the needs of the individual user. 

A speaker independent system does not need to be trained 
by users. Anyone can use it at anytime. The limitation is 
that the vocabulary is set and cannot be modified to suit 
personal needs. Currently, speaker independent, continuous 
speech systems are not yet readily available for integration 


into existing applications. 


B. SPEECH RECOGNITION EQUIPMENT AT NPS 

For this thesis we considered several types of ASR 
systems available at the Naval Postgraduate School (NPS). 
One system is the Threshold Technology, Inc. Model T600 
voice recognition system. With memory enhancement, the 
system can handle up to 256 discrete utterances. An utter- 
emeec 1S a woresor phrase lasting from Owl to 2.0 seconds. 
Beet, l6é:-p. 28] 

There are also two continuous speech systems, the Verbex 
3000 and Verbex 4000, developed by the Verbex Company. The 
3000 can handle up to 360 utterances divided into as many as 
20 separate vocabularies. When a person uses one vocabu- 
lary, input can be continuous. If more than one vocabulary 
is involved then the user must pause as the system switches 
to the appropriate vocabulary. Each vocabulary is a finite 
number of words. The user must program his own applications, 
thereby making him independent of the customer engineering 
seryWees which Verbex provided: The Verbex 3000 unit is a 
large, bulky system (9 to 10 cubic feet) so we did not 
CeOhsomeecrmreiis a Viable “Option for testing with JAMPS II.V. 
| Resa 6:= pp. 29=30) 
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The Verbex 4000 is a smaller, more portable system. ic 
is used in conjunction with an IBM Personal Computer. The 
vocabulary is limited to approximately 100 utterances. The 
user builds each vocabulary by using the computer's line 
editor. The vocabulary is then translated by the 
Verbex-supplied software for subsequent use by the 4000. 
Although the vocabulary capacity is 100 utterances, a 
complex vocabulary can significantly reduce the system's 
word capacity. 

A third continuous speech system recently became avail- 
able at the NPS. We chose this ASR system, the Texas 
Instruments (TI) TI-SPEECH, for our thesis work. It can be 
installed in the TI Portable Professional Computer or an IBM 
Personal Computer, both of which are available at the NPS. 
The next chapter will detail the system, its use, and the 
development of vocabularies. There were four basic reasons 

why we chose the TI-SPEECH: 
| © IBiecemeacrba lie 
e 450-word grammar in 9 separate vocabularies; 
¢ ease of training; 
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C. RELATED STUDIES 

There have been a great number of studies conducted at 
the NPS in the area of voice recognition. The reports 
include the performance of naive versus practiced speakers, 
the effect of feedback on users of ASR equipment, and the 
effects of stress and changing environments on the user of 
various recognition systems. A more complete list of the 
studies can be found in Appendix B. 

One particular study explored the use of continuous 
speech, discrete speech, and keyboard input to an interac- 
tive naval warfare simulation. The authors of the study and 


a follow-on report did not consider the results conclusive. 
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However, the results did demonstrate a definite advantage of 
continuous speech input over the discrete mode [Ref. 16: pp. 
2]. This, combined with the ASR capabilities of the speech- 
equipped TI computer discussed in the next chapter, impacted 
On our decision to select a continuous speech system, 
particularly the TI system. 


D. ADVANTAGES AND DISADVANTAGES OF SPEECH I/0 

As one can see in Tables 2, 3, and 4, there are both 
pros and cons to using ASR as an input device [Ref. 15:  p. 
3161 . These tables also list the advantages and disadvan- 
tages of speech synthesis as an output technique. Since we 
are concerned only with speech input, ASR items of interest 
are highlighted below. This is not to say speech synthesis 
is not an extremely important aspect of speech technology. 
Instead, it is beyond the intended scope of this thesis. 

l. Engineering Advantages/Di sadvantages 

The first two advantages, speed and accuracy, are 
keys to the application of ASR to any system. They are espe- 
cially important in a C2 subsystem such as JAMPS II.V. Speed 
and accuracy emphasize our goal of reducing the time to pass 
Smemeecasions and shortening “the timeline within the C2 
process. The additional advantages listed can enhance an 
existing C2 system by integrating ASR technology. 

The disadvantages can be dealt with by controlling 
the environment. People can reduce ambient noise and adjust 
the physical conditions under which the system will operate. 
The third disadvantage does not apply, Since JAMPS isa 
message preparation system and record copies of the input 
are made automatically at the operational facility. Finally, 
the use of a microphone is not necessarily a disadvantage 
because it focuses the attention of the user on the video 
terminal and reduces the amount of external noise that will 
intrude on the ASR system. When an operator wears a head- 


mounted microphone, he frees his hands for other tasks. 
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TABLE 2 
ENGINEERING ADVANTAGES AND DISADVANTAGES OF ASR INPUT 


Can be faster than other communications modes. 


Can be more accurate than other communications modes. 


Compatible with communications systems (telephone). 


Can reduce manpower requirements. 


Possible interference from noise, distortions, 
competing talkers. 


Physical conditions (vibrations and physical 
Orientation of speaker) may change speech patterns. 


No permanent record of speech (unless explicitly 
recorded). 


Microphones needed for speech input, and acoustic 
speakers needed for speech output. 





Be Pyschological Advantages and Disadvantages 
When one deals with the interface between man and 


machine, the psychological problems take on an even greater 
Significance than one might realize. The closer to natural 
speech the ASR system conforms, the easier it will be to 
implement the speech recognition techniques. Speech is 
considered the most natural form of communication. Being 
able to "talk to one's computer" could ease some of the 
reluctance an inexperienced computer user might encounter. 
The psychological disadvantages parallel the advan- 
tages. The same computer fear that might be eased by the 
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AS yas, 
PSYCHOLOGICAL eae ie DISADVANTAGES OF ASR 


Most natural form of human communication. 
Best £0r geoup problem solving. 

Universal among humans. 

Can reduce visual information overload. 


Increases in value when person is engaged in complex 
thought processes. 


Speech is not private; others may eavesdrop. 


Psychological changes (stress) may change one's speech 
Gigaracteristics. 


speech synthesis may interfere with other aural 
im¢gdacators. 





ability to speak commands to a machine could be intensified 
instead. Humans tend to feel awkward when speaking to an 
inanimate object. However, successful operation of the 
system in the initial stages should ease the problem. As ASR 
becomes more prevalent, it may well become the normal mode 
of input. The environment in which the JAMPS II.V will be 
used (such as tactical C2 centers) will negate any problems 
encountered as a result of the lack of privacy associated 
with speech. These facilities and the associated messages 
are not intended to be private to those people who work 
there. 


oy 


TABLE 4 
PHYSIOLOGICAL eecm ac sa DISADVANTAGES OF ASR 


Requires less effort and motor activity thane 
communications modes. 


Frees the hands and eyes. 
Permits multimodal operation. 
Feasible in a darkened area. 


Is omnidirectional; doesn't need direct line of sight 
between user and ASR system. 


Permits operator mobility. 


Contains information on identity and emotional state 
of the speaker. 


- Contains information on physical state of the speaker. 


Simultaneous interaction with man and machines. 


tO andes Speed may cause fatigue, which may in 


turn change speech characteristics. 


Illness may change speech characteristics. 





Se Physiological Advantages and Disadvantages 
The physiological advantages work toward easing the 
stress and fatigue on an operator making him more versatile 
in a C2 environment. As for the disadvantages, any factor 
which reduces these negative factors will aid and improve 
the C2 system. Both ASR technology and the operators them- 
selves should recognize and compensate for these adverse 


factors. 
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E. SUMMARY OF ASR 

In this chapter we talked in general terms about voice 
recognition and what ASR systems are available at NPS. We 
also wanted to address some of the pros and cons of using 
voice recognition ina CZ environment. These are valid 
points to weigh when considering the interface of ASR tech- 
nology with a C2 system like JAMPS II.V. The next chapter 
Mellin G@eal with the specific operation of the TI-SPEECH on 
the TI Portable Professional Computer. 


So 


IV. TI-SPEECH 


A. INTRODUCTION 

As mentioned in the previous chapter, there were several 
voice recogns cloM systems available at the Naval 
Postgraduate School for our use with this thesis. The 
system we selected was the Texas Instruments Portable 
Professional Computer (TIPPC) with the Texas Instruments’ 
SPEECH (TI-SPEECH) system installed. 

Earlier studies have demonstrated a significant advan- 
tage of continuous speech recognition over discrete speech 
recognition £0F (davasinpue. The TI-SPEECH system can be 
operated in either a continuous recognition mode or a 
discrete recognition mode. 

The TI-SPEECH has a vocabulary that far exceeds any 
other system that was available. Each of the 9 vocabularies 
has the capacity for as many as 50 utterances. 7? However, 
each vocabulary can only be 32 seconds in length. lf Gite 
user develops his vocabulary with very short utterances, 
then the 50-utterance limit will be achieved. If the utter- 
ances are longer, then the time limitation may be exceeded 
before the utterance limitation. The system was designed to 
enable the user to link up to 9 vocabularies together, thus 
a total of 450 utterances are available to the user. 

The ease with which the ASR system can be used was also 
a factor in our selection. Texas Instruments’ use of menus 
and pop-up windows has simplified the procedure to the point 
that entry of a new vocabulary takes much less time than the 
other ASR equipment at this school. A user with very little 
experience can enter, train, and refine a 50-word vocabulary 


in less than an hour. 


’We define an utterance as the word or phrase the user 
expects the ASR system to recognize and respond to. 
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Since the JAMPS is meant to operate on mobile microcom- 
puters, the portable TI system's (with TI-SPEECH imbedded) 
physical characteristics and computing capability make it a 
viable option to consider in order to run the JAMPS software 
with voice recognition.* With the exception of the Verbex 
4000, the other ASR_ systems available at the Naval 
Postgraduate School are large and awkward. The degradation 
in mobility would offset any gains provided by using speech 
Ppt. The Verbex 4000, although smaller and lighter than 
the Verbex 3000, could integrate well with JAMPS. However, 
the limitations on the vocabulary size and the difficulty in 
creating vocabularies offset the size advantage. 

The following sections will describe the hardware of the 
IPPC, the software involved in the speech recognition 
system, and some guidelines for developing, entering, and 
training a vocabulary. In Appendix C is a user's guide that 
provides a basic step-by-step procedure for using the speech 


recognition system and bringing up JAMPS. 


B. TEXAS INSTRUMENTS PORTABLE PROFESSIONAL COMPUTER 
tnesbasic TIPPC comsists of folir™standard parts: 

e Keyboard; 

Teeoeoracing Instructions; 

TMC tAgiOstlG SOLtware; 

e system unit. 
Texas Instruments provides these basic components for each 
Sopputrer j ref. 17: .p. 1-3]. There are many other options 
that can be added to the TIPPC; some are hardware related 


*Remember, our primary purpose is to investigate the feasi- 
pawbety Of usin voice recognition as_an input medium. to 
JAMPS. Using TI-SPEECH meant that the JAMPS software had to 
be loaded onto the TIPPC, which is what TAFIG _and MITRE 


helecenus..do. .At this time, we feel that the TIPPC with 
TI-SPEECH installed is an operon Worth pursuing for the 
running of JAMPS. We stress that more research is necessary 





in order to substantiate or refute our thesis. Our last 
chapter, CONCLUSIONS AND RECOMMENDATIONS, lists some topics 
to consider for future research before any decision would be 
made concerning the use of voice recognition with JAMPS. 
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and some are software related. The voice system ( TI-SPEECH) 
is one such option. The voice system incorporates both 
hardware and software and will be detailed later in the 
chapter. 
1. Keyboard 
The keyboard is similar to the one found on an elec- 
tric typewriter. The keyboard, as you see in Figure 4.1, is 


divided into four major areas: [{Ref. 18: p. 1-1] 


© || @ 


~ 


SESE 





Figure 4.1 TIPPC Keyboard Layout 


e main keyboard area - similar to a typewriter and used 
to enter alphanumeric data; 


* numeric keypad - used as a calculator and for numeric 


CmeLy 

° Se key cluster - used to control display cursor move- 
ment; 

¢ function keys - 12 keys arranged in3 groups of 4; 


these keys are programmable, and their functions can be 
changed from application to application. 


The keyboard also contains a microprocessor which 
converts keystrokes into character information and conducts 
keyboard diagnostics each time the system 1S powered up 


[Ref. 18: p. 1-1). There are other special purpose keys 
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present on the keyboard; some will be used and some will 
not. As it becomes necessary to use a special key, we will 
define its purpose and indicate its position on the 
keyboard. 
4. Operating Instructions 
iie™=aperating™@anstructions provide information “on 
the initial set up and operation of the TIPPC. Included are 


chapters on problem solving, hardware options available, 
shipment or movement of the computer, and several append- 
ices. The operating instructions are invaluable to both a 


first-time computer user and an experienced user. 
3. Diagnostic Software 

The diagnostic software provided by Texas. 
Instruments checks out the computer system. The tests run 
by the diagnostics are more extensive than the power-up 
checks run each time the system is turned on. These tests 
will aid in the identification of problems should the system 
not operate properly. 


4. system Unit 





The system unit consists of the following basic 

components: 

e central processing unit (CPU); 

me Ppagpalle!l printer port; 

¢* power supply; 

¢ random access memory (RAM); 

e system unit board; 

e § 1/4 inch diskette drive; 

© display unit. 


These components make up the computer itself. In the 
portable model we operated, the components are all ina 
Compact Wait 19 x 17 x 825 inehes. [Ref 18: p. 1-2] 

The CPU of the system unit consists of an Intel 8088 
leo Fe  Mlcroprocessor, clock cireults; bus buffers and 
latches, bus controller, and the reset circuit. [Ref. 18: 
p. 2-11] 
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The parallel printer port contains a 25-<pin female 
D-Type connector. Printers with centronics-compatible 
interfaces use this port. [Ref. 18: p. 2-16] 

The power supply is a switch type, 110 watt unit 
with 3 output levels. It is designed to support a system 
equipped with every hardware option available for installa- 
tion into the computer. [Ref. 18: p. 1-2] 

The basic computer system contains 64 kilobytes of 
dynamic RAM. The computer we used already had its RAM 
expanded to the maximum of 768 kilobytes by adding optional 
expansion memory boards. [Ref. 18: p. 1-3] 


The system unit board, also called the motherboard, 








1s the heart of the computer system. It 1s divided Vincowmevc 
sections. First, the systems support section contains some 
key components such as the keyboard port, CPU, input/output 
system, interrupt and memory systems. As we mentioned 
earlier, the CPU consists Of an intel SOc) te-bic mieeeoeo ams 
cessor. Our system has been enhanced with the optional 
Intel 8087 numeric data processor (also known as a numeric 
co-processor) [Ref. 18: J2) See A Orel o kee ACs te lee The second 
section of the motherboard is for the expansion bus. Allow = 
section provides the space for installing the various option 
boards available for the TIPPC [Ref. 18: p. 2-56]. 

One 5 1/4 inch diskette drive is standard with the 


eee ee The drive is a mass storage device for reading from 





Or writing to a standard 5 1/4 inch removable diskette. The 
diskette can store approximately 320 kilobytes of data. 
There are many hardware options available for 
installation onto the TIPPC. The following options were 
added to the computer system we used: [Ref. 18: p. 1-3] 
* expansion memory boards = total RAM is 768 kilobytes; 
* numeric co-processor; 
¢« Winchester (hard disk) drive - the Winchester disk 
drive and controller are available with 5 or 10 mega- 
ES Capacities. The system available to us contained 
the 10 He dae vee drive. It is installed internally to 


the computer system in the space set aside for a second 
5 1/4 inch diskette drive. 
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* synchronous-asynchronous communications board - this 
board PeEEiits —COMMunI Catton. thieughn fa standard 
RS=-232=-C interface. Asynchronous data rates from_ 50 
bits per second (bps) o 19,200 bps are supported by 
the communications board. 

There are other options available but are not 
installed. These include internal modems and a graphics 
Comerol board. They are not applicable to our thesis and 


will not be discussed. 


C. AUTOMATIC SPEECH RECOGNITION SYSTEM 
The entire TI-SPEECH system encompasses many aspects of 
voice processing. These include voice recognition record 
and playback, text- to-speech and telephone management capa- 
Eaveeties. The integration of all these capabilities raises 
interesting possibilities for use with JAMPS, but that goes 
beyond the scope of this thesis. We will concentrate on the 
voice recognition aspect, Vocabulary Manager (VM), of the 
TI-SPEECH system. The VM, which we describe later, is 
coupled with a Transparent Keyboard( tm) feature that over- 
lays other applications.° When the Transparent Keyboard 
recognizes a voice command, it passes the appropriate 
command along as if the Keyboard had been used. 
1. Hardware 
The TI-SPEECH hardware consists of several items. 
These include the following: [Ref. 19: p. 1-2] 
* microphone and speaker; 
* TI-SPEECH Diagnostics, Algorithms and DSR Diskette; 
. SUl=sPeecH board: 
e TI-SPEECH Installation Guide. 
The microphone and speaker are external items used 


SoaEnpuUc,oucpUut deyvaces. They can be replaced by an 
optional headset. The headset includes a microphone for 
input and a single earpiece for output. The headset frees 
the user's hands for other operations. If voice synthesis 
>Transparent Keyboard( tm) aS a trademark of Texas 
istrmuments, Inc. 
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is used, the earpiece provides privacy. We used the headset 
Lor Our tes trauns: 

The installation quide is exactly what the name 
implies. It provides the detailed instructions needed to 
install the TI-SPEECH board into the computer. It also 
provides a description of the diagnostic routines available 
with the hardware kit. 


The TI-SPEECH Diagnostics, Algorithms and SR 
Diskette might be considered software, but since Texas 


Instruments considers it part of the hardware kit, we will 
discuss it here. The diagnostic routines test the speech 
board and optional telephone interface board, if installed. 
If more than one speech board is installed, each one is 
tescred 1h secquenes The Soutines wcheck Che overall lecreea. 
tion of the speech board, anda final test checks different 
combinations of input and output devices. [Ref. 19: p. 5-7] 

The speech algorithms implement the capabilities of 
the speech board. The software is executed by the TMS320 
(see below). There are eight different algorithms that deal 
with the speech processing available. They include algo- 
rithms dealing with text-to-speech, analysis/synthesis, 
recognition/synthesis, dial telephone, and continuous recog- 
nition [Ref. 19: p. 1-8). We will be using only the contin- 
uous recognition algorithm. This ‘aloericechm orevides for ene 
recognition of a user's isolated (discrete), connected, and 
continuous spoken phrases. These three modes provide the 
user with more flexibility in customizing his speech input 
to specific jobs or applications [Ref. 19: p. 1-12]. 

The device service routine (DSR) enables the disk 
operating system (DOS) software to access the capabilities 
of the TI-SPEECH hardware. The DSR provides the software 
interface between the speech hardware and the application. 
The DSR must be installed into computer memory each time a 


user wishes to use the speech hardware. Once installed, the 
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DSR remains available unless the system is rebooted, in 
which case it must be reinstalled. [Ref. 19: p. 1-6] 

ome SEI-SPEECH boarmém is the key to the speech 
processing system. See Figure 4.2 for a general overview of 
the speech board architecture. [Ref. 19: p. 1-4] 





Algorithm memory input/output 


microphone 
interface 


Speaker 
or headset 


Dual-port memory TSS 20 


Bus 
interface 





Figure 4.2 TI-SPEECH Board Architecture 


The TMS320 is a 32-bit microprocessor that executes 
> million instructions per second. It is a special-purpose 
MreenOprocessor for “digital signal processing. The speech 
algorithms are executed by the TMS320. The algorithm memory 
uses eight kilobytes of the TI-SPEECH board RAM. The 
current algorithm in use is stored and available to the 
Miss20O for execution. The dual port memory stores speech 
data during speech processing. TewconsistsS Of SZ KLlobyces 
of speechboard RAM. Here is where the specific speech temp- 
lates are held when using speech recognition. These temp- 
lates are the voiceprints created by each user for his 
specific vocabularies. The memory is referred to as dual 


port since it can be addressed by the bus interface of the 


computer as well as the TMS320. Dual-porting enables the 
TMS320 to transfer speech data more quickly. PRet.» 19S eee: 
1-4] 
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The input and output interface is the cineudgtry that 
connects the speech board with the input/output devices, 
headset and speaker (or microphone). It enables the user to 
select specific devices and to set output volume and input 
gain. [Ref. 19: p. 1-5] 

The CODEC is a standard analog-to-digital (AD) and 


digital-to-analog (DA) converter. It changes the analog 
inputs to digital signals for processingnb,) sano looce. ie 
then translates the microprocessor'’s digital response to 
analog signals that are output to the user. lRet. -19: yee 
1-5] 


2. Software 
There are several types of software available when 
using the TI-SPEECH system: 
¢ NaturalLink( tm); 
e MS(tm)-DOS operating system; 
¢ TI-SPEECH Vocabulary Manager. ® 
The NaturalLink software allows the novice user to more 
easily access MS-DOS. It is not necessary for the execution 
of the speech recognition software. Appendix C, the user's 
guide, will show the user how to bypass the NaturalLink and 
execute the Vocabulary Manager programs without it. One can 
find further details on the use of NaturalLink in the Texas 
Instruments’ manual, "NaturalLink@Aecess tomllo-DOs, DL) e2 ame 
Number 2243754-0O001. 
MS-DOS is the disk operating system (DOS) provided 


Palio Neiotawe lk iete- The VM software is designed to use MS=<DOS 
or the IBM Personal Computer DOS. Our TIPPC is using MS-DOS 
Version. 2.13. The disk operating system is a collection of 


basic computer programs designed to simplify tasks you need 
to use with your computer from time to time. Basically, it 


acts as the manager/controller for your computer. 


yee Ea ev is a trademark of Texas Instruments, Inc. 
MS( tm) is a trademark of Microsoft Corporation. 
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The Vocabulary Manager (VM) is the software portion 
Of ene TI-SPEECH system that enables aiuser to give voice 
commands to his computer. Using VM, an operator can create 


and store his own vocabularies for specific applications, 


refine and test created vocabularies, link several vocabu- 
laries together or use and modify the sample application 
vocabularies provided with the TI-SPEECH system. [Ref. Ze: 
pp. 1-2 to 1-3) 

The VM software kit contains a user's manual, the 


TI-SPEECH VM guide with three ring binder and tabs, two 
Vocabulary Manager diskettes, and four Vocabulary Manager 
tutorial diskettes. The software kit, when combined with a 
computer and the hardware kit previously discussed, make up 
the Automatic Speech Recognition system. 

The tutorial diskettes are excellent tools for 
familiarizing a user with the basics of using the VM. It is 
recommended the first-time user utilize the tutorial to get 
started with the ASR system [Ref. 20: p. 1-2]. If the tuto- 
rial is not available, our user's guide found in Appendix C 
will provide the basic commands to enter, train, and begin 
uSing a vocabulary. 

When the user first brings up the Vocabulary 
Manager, the main VM menu will appear. Figure 4.3 shows a 
general outline of the main menu. | 

Section 1 is the menu area in which the commands the 
user selects are built. When a command is complete, it will 
prompt the user to press the ENTER key found on the lower 
right hand corner of the numeric keypad described in the 
hardware section of this) thesis. 

Section 2 is the area in which you can find the 
command segments. A person selects a segment by using the 
control arrows to move the highlighted area to the desired 
segment and pressing the RETURN Key. Seceaon S 1s a Listing 


of available vocabularies. The arrows, section 4, indicate 


AQ” 





XG, 1 


Figure 4.3 ‘Vocabulary Manager Menu 


there are more items above or below the window which the 
User Can Dreger tO ac ves 

Section 5 shows the function keys available at any 
particular time during the use of the Vocabulary Manager. 
Occasionally pop-up windows will appear over the menu. 
These windows display help messages Or prompt the user to 
input more information [Ref. 20: p. 2-4]. 

The cursor control keys are between the numeric 
keypad and main keyboard area (See Figure 4.1). Use the 
cursor arrows to move the highlighted area from command 
segment to command segment. The RETURN key is found on the 
right side of the main keyboard and is used to select a 
highlighted segment. The ENTER key, as mentioned above, 


will execute a command once it is Dull, 
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D. BUILDING A VOCABULARY 

The first thing a user must do is decide to which appli- 
cation he is going to apply voice recognition. In the case 
of this thesis we selected the JAMPS software. Once the 
user is familiar with the commands needed to operate the 
semeware, Ne 1s ready to begin building his vocabulary. 

The next step is the selection of phrases or utterances. 
These are the words the user will say when executing his 
software. The phrases or words can be anything the operator 
chooses, but some things should be kept in mind. The words 
should relate in some way to the commands they will be asso- 
ciated with; this will make them easier to remember during 
use. Multi-syllable words are better since they give the 
computer more sounds to recognize. Homonyms, such as right 
and write, should be avoided for obvious reasons. Words 
that appear within other words, like the six in sixteen or 
SieScy, should also be avoided. Consideration of these 
points will make it easier to design a vocabulary and have 
it recognized with a minimum of errors. [Ref. 20: p. 3-3] 

Once the person forms the phrases, then he must match 
the keystrokes (maximum of 40 characters) needed for the 
execution of the commands associated with phrases.’ When the 
complete list of phrases and keystrokes is done, the user is 
ready to enter them into the computer. Appendix C provides 
the commands and steps for the entry. 

After the user has entered the vocabulary, he must 
create his voiceprints by "training" the speech system to 
recognize his voice. To enhance the effectiveness of the 
training session and subsequent recognition in the operating 
environment, several guidelines should be considered. You 


should use the same input device each time for the same 


TNote that "phrases" is the left hand column displayed by 
the Voice Manager. "Keystrokes’ is the right hand column. 
Phrases are your spoken words or commands, while keystrokes 
are the corresponding computer response. 
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vocabularies. If training is done using a headset then the 
headset should be used during operations. The input device 
should be placed in the same location each time it is used. 
Insure the input device is on before beginning the training 
session. Turning it om ama off during a Ssescuenm Coulda 
create problems. Training should be done in an environment. 
that closely approximates the operating environment. If the 
operating environment is very noisy, the voice patterns 
Should be created ina quiet environment and subsequent 
training done in a noisy environment approximating the oper- 
ating environment. Also, the user should use a normal tone 
of voice. The same speech style will help the user reach 
consistent recognition. [Ref. 20: p. 3-6] 

As mentioned earlier, the system has the capability of 
recognizing continuous speech. To enable this mode the user 
must first create the voiceprints using only the phrase. 
Then the voiceprints should be refined using the phrase to 
be recognized ina sentence. Sentence content is not impor- 
tant. The idea is to get the computer accustomed to recog- 
nizing the phrase in sentences with other words. [Ref. 20: 
De ool 

The ASR system user can edit a previously created vocab- 
ulary with a series of commands. The commands become avail- 
able to the user when he selects the command "set up and 
train a vocabulary" from the main menu. The options that 
appear permit the user to further customize and refine his 
vocabulary. [Ref. 20: pp. 3-10 to 3-11] 

The individual must test his voiceprints when he has 
finished creating them. As the voiceprints are tested, the 
VM provides feedback which is of great value to the user in 
enhancing error-free recognition. As the user speaks each 
phrase, a pop-up window, as in Figure 4.4, will appear. 

If TI-SPEECH does not recognize the phrase, the message 


in the window will indicate such. The user should repeat the 


SZ 


Recognized: Match: 


Next Best: Match: 


\ 
N 
~ 
» 
x 
~ 
\ 


Minimum Acceptable Match: 


HEEL, 


SEA REESE 





Figure 4.4 Pop-up Window for Vocabulary Testing 


phrase; and if recognition still does not occur, the user 
should recreate the voiceprint. If the phrase is recog- 
nized, the pop-up window will show a match number ranging 
from one to ten. seven to ten indicates a good match; four 
Ee six Js a-fair match; and one to three is a poor match. A 
poor match means recognition will not be consistent and the 
voiceprint should be further refined to insure consistent 
BeGogh 1 tion. A fair match means recognition will occur, but 
errors will also be present; further refinement might be 
necessary. 

The next best match gives the user an indication that 
another utterance has a voiceprint similar to the actual 
spoken phrase. If the match number in the next best match 
differs by only a value of one or two, then the user should 
change one of the phrases to avoid possible recognition 
errors. Usually the voiceprints will be sufficiently 
unique so that no next best match will be given. 


Finally, the minimum acceptable match shows the level at 


which the VM will provide recognition. If the person sets 
the level to one, the speech system will recognize all 
matches equal to one or greater. If the individual sets the 


level to four, TI-SPEECH will recognize matches greater than 


or equal to four. , You can adjust the minimum acceptable 
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match with the “optimize recognition" command. [Ref. 20: 
p. 4-4] 

Each vocabulary a user enters can hold a maximum of 50 
words. A more definitive limitation is the fact each vocab- 
ulary is limited to 32 seconds of phrase time. Tf shows 
phrases are used, it is possible to reach the 50 phrase 
maximum. However, if a person incorporates longer phrases, 
then the time allocated will be expended before reaching the 
50 phrase limit. In the case of some complicated. applica- 
tions, the user must exceed the 50 phrase limit to create 
all the commands he needs. This is not a problem since VM 
provides the capability to link as many as nine vocabularies 
together. 

There are some points to keep in mind when linking 
together a group of vocabulamies- First is the ameouvmeror 
RAM available. Each vocabulary occupies 26 kilobytes of RAM 
when it is full [Ref. 20: p. 4-6]. Since our computer 
system had been fully enhanced to 768 kilobytes of RAM and 
we linked only three vocabularies, we did not encounter a 
memory problem. : 

If you are going to use more than one vocabulary, you 
must initially load the ones you _ . need; otherwise the 
computer must be restarted to make additional vocabularves 
available. The user should also keep in mind the VM will 
only recognize phrases in the "active" vocabulary. Ths 
means that the same phrase may be placed in different voca- 
bularies, but with different keystrokes associated with it. 
The user must remember which vocabulary 1s active, since the 
TIPPC provides no indication. [Ref. 20: p. 4-6] 

When a user has more than one vocabulary available in 
memory, he has one of two ways to move from one vocabulary 
to another. First, he may use the main menu. This necessi- 
tates leaving the application in which he is working, 


changing the active vocabulary, and themeneturning Scostde 


24 


appwircation: Hits 25 Snot a dm@erticult process but Pt does 
take time. [Ref. 20: p. 4-7] 

The other method is through the use of key switch words 
which enable the active vocabulary to be changed by a voice 
command. Insertion of the switches adds a little time to 
the preparation of a vocabulary [Ref. 20: p. 4-8]. However, 
the user can change vocabularies without leaving his appli- 
cation program. In the case of JAMPS this can be a signifi- 


cant time saver. 


E. SUMMARY 

ie Cais chapter we introduced you to the Texas 
Instruments Portable Professional Computer and TI-SPEECH. 
This was a necessary overview of the hardware and software 
associated with the IBM-compatible microcomputer that the 
JAMPS software can run on, and the voice recognition system 
which can execute the JAMPS software. We also included some 
MelPLcuL anformation about creating, micaining, anid Using 
vocabularies. More details can be found in Appendix C. And 
if the reader wants even more information, the references 


for the TI manuals are in the List of References. 
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V. A MEASURE OF PERFORMANCE FOR MESSAGE PREPARATION 


This section covers the development of ameasure of 
performance (MOP) which can be used in preparing messages. 
The goal is to quantitatively compare themmautoma-ecemecaed 
of message preparation (JAMPS) versus the manual method of 
preparing JINTACCS messages. Specifically, this MOP focuses 
on the time element involved in preparing messages up until 
time of transmittal. Time is a crucial factor in the C2 
process when some military force must act before a given 
event takes place. JAMPS is designed to save time over 
manual message preparation so a quantitative comparison is 
essential in determining JAMPS usefulness. Since this 
performance measure is simple and generic, it could also 
compare JAMPS using voice recognition as an input medium for 
some portions of hard-copy messages to JAMPS using just the 


keyboard for input. 


A. WHY AN MOP? 
In doing this research, we had a choice of developing a 
measure of performance or ameasure of effectiveness (MOE) 


to characterize the system involved in the message prepara- 


tion process. As stated in the 1985 Command and Control 
Evaluation Workshop, performance and effectiveness measures 
Should have the criteria [Ref. 21: p. 6-13] listed in Table 
be The only criterion that was suspect in choosing a 
measure was independence. One could conceivably have a 
measure which affects another measure. For example, let's 


Say one measure for a communications system is the average 
number of formatting errors per message prepared. Let's 
further assume a message cannot be transmitted with format- 
ting errors, so an operator must correct these errors. What 


if another measure of this system is the time needed to 


He 


prepare a message for transmission. In this case the format 
errors affect the time for preparation as a measure. Hence 


these measures could not be mutually exclusive. 


TABLE 5S 


DESIRED CRITERIA FOR PERFORMANCE AND EFFECTIVENESS 
MEASURES 


CHARACTERISTICS DEFINITION 


Mission Oriented Relate to force/system mission. 


Prose hininacory identity seal di trercnices 
between altermnacives. 


Measurable Able to be computed, or 
estimated. 


Quantitative Able to be assigned numbers, or 


ranked. 


Realistic Relate realistically to the C2 
and associated uncertainties. 


Objective Defined independent of 
Sub) Cai, C eOpaton sa oOMme 
measures cannot be objectively 
defined). 


Appropriate Relate seeomocecec petiole. Standards 
i and analysis objectives. 


pensitive Reflect changes in system 
Variables. 


Inclusive Remuec CP enOse stamcaras, needed 
by the analysis objectives. 


Independent Mutually exclusive with respect 
to other measures. 


Simple Easily understood by user. 





Using the 1985 Command and Control Evaluation Workshop 
as a guide, we chose to use an MOP instead of an MOE in this 


analysis. We are looking at a certain portion (i.e., 


a 


subsystem) of a larger C2 system. Specifically, our 
subsystem is the equipment and procedures used for message 
preparation which "cccurs in Sanwepe dict ona) ser aeil ieee 
larger C2 system is the entire tactical command and control 
system and its accompanying C2 process associated with a 
specific mission, such as air defense or fire support. By 
choosing an MOP vice MOE, we can clearly bound the C2 system 
we are analyzing. We set these boundaries based on the 
application of our analysis, and the process we analyzed 
takes place within the limits of the C2 system. We have 
delineated the system being studied from its environment 
[Ref. 21: p. 8-4]. In this way we can more easily model the 
message preparation process. The next section outlines the 


system of interest and its boundaries. 


B. MODEL OF THE MESSAGE PREPARATION PROCESS 

In drawing a model of the message preparation process, 
we had to concisely depict the steps involved in preparing a 
message for transmission. Figure 5.1(a) shows this current 
process. Figure 5.1(b6) shows the JAMPS process. 

1. Manual Preparation 


In. a tactical “CZ paca ty; the message process 
starts with some stimulus to send a message. (See Figure 
5.1(a) for a model of the message preparation process). A 


stimulus may result from a change in the battlefield envi- 
ronment or a need to redirect forces. Because of this stim- 
ulus, a commander (more likely his staff) will hand-draft a 
message on a joint message form, which must then be typed 
accurately to meet the stringent JINTACCS formatting. The 
drafter will normally review the typed message, check for 
errors, and either return the message for corrections or 
give the message to the releasing authority. The releaser 
usually reviews the message, checks for mistakes, and then 
Signs the message for release if there are no changes. Once 


the message is ready to be transmitted, a runner must carry 
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Message stimulus Message stimulus 
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Figure 5.1 Message Preparation Model 


Spe 


the message to a communications center. Here at the center, 
one of two things will happen. The communications center's 
personnel will either accept the message and log (record) it 
in or reject it. If they accept the message, then they are 
responsible for retyping the message or putting it through 
an optical reader for subsequent transmission over external 
military communications. hee the communications center 
rejects the message for errors or some other reason, then 
the operational facility must redo the message. More time is 
Lose. 

There are certain administrative procedures inherent 
in the manual preparation model that take additional time. 
For instance, once the message arrives at the communications 
center, the message must first be accepted and then logged 
in by the center. The operational C2 facility must also 
record the message information. And should the communica- 
tions personnel tear the message form or make an error, then 
they would need to retype the joint message form. We did not 
reflect these added steps as separate blocks in the model, 
but one should be aware of them. 

This model is generally the process followed by 
military units when in joint tactical operations. The 
specific procedures, such as drafting or reviewing, may vary 
somewhat amongst operational facilities. 

2. JAMPS Preparation 

Looking now at Figure 5.1(b), one sees that the 
JAMPS message preparation model starts with the same stim- 
ulus for a message. Because of this stimulus, someone within 
the C2 facility hand-edrafts a joint message form. This is 
where the steps vary from the manual preparation model. A 
JAMPS operator will use the draft message to complete a 
fill-in-the-blanks message template on his video terminal. 
The drafter can review the message on the screen or the 


operator will give the drafter a print-out copy of the 
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message ready for transmittal. If any changes are necessary, 
the JAMPS operator can quickly recall the message from the 
stored messages. The next step is for the releasing 
authority to review and approve the message. When approved, 
the message is transmitted directly by the JAMPS workstation 
serving as the communications gateway. 

Comparing the two models of Figure 5.1, one sees 
fewer steps in the JAMPS process. A tactical commander can 
conceivably save valuable time in his C2 process by using 
JAMPS. His operators will not need to type messages from 
scratch. Nor will runners need to carry a message to a 
communications center where more time is necessary to send 
out the message. But the question still remains, "How much 
time can be saved?" 


C. ASSUMPTIONS AND LIMITING FACTORS 
In developing an MOP, we had to narrowly define what we 
were analyzing. We made certain assumptions, which can also 
Se lamiting, in order to meet these desired Criteria 2or 
measures from Table 5: 
* mission oriented; 
Teeeuscmaminatcory > 
¢* measurable; 
. Gianeitacive; 
- Teagasc; 
e objective; 
° appropriate; 
eh me Lusive > 
e simple. 
Our assumptions, as they relate to the message prepara- 
thuienmmecdels im Figures. 1, are as follows. 


(a) The two GOmpaeing systems which model message prepa- 
ration are treated as "black boxes" due to the bound- 


aries. 
(b) We considered all other environmental factors as 
being equal for the two systems. Mer instance, both 
systems are in the same tactical scenario, they both 


use the same external military communications and 
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switches for transmission, the message stimuli are 
the same for both _models, | and we are dealing with 
Simiar tactical CZ tacgalere 


(c) ie people within the systems are qualified in their 
jobs. 


(d) The like C2 facilities are handling like messages 
(i.e., message types and precedence). 


(e) The systems are functioning during tne time period in 
question. The system So ae and check-out times are 
neglected. This is a limiting assumption should one 
try to develop another MOP or expand the analysis 
scope to create an MOE. 

We tailored these assumptions for ease in comparing the 
two systems. One "black box" can be tested against another 
just by swapping them, all other factors being equal. With 
the appropriate model and assumptions having been stated, 


the next step is to derive a measure of performance. 


D. DEVELOPING THE MOP 

We used an analogy to the command and-.control timeline 
analysis, as seen in the Command and Control Evaluation 
Workshop, to develop the MOP [Ref. 21: p. 5-14]. Figure 5.2 
shows the timeline for the process.of message preparation. 
The application is straightforward. Some event in the combat 
environment serves as a stimulus for a message. This happens 
at time S. The tactical commander and his staff have a 
certain time by which they must respond to the event with a 
message. Otherwise the message will be sent too late to make 
any difference on the combat environment. This is time NL. 
The time the message is actually transmitted is time T. So, 
NL, and T are specific points in time, not elapsed times. T 
may be greater than, equal to, or less than NL, depending on 
how well the message preparation process is executed. For 
illustration purposes, we used T less than NL. The time 
between message transmittal and message stimulus is mp (mp = 
Lea) Residual time, r, is the difference between the 
no-later-than time and actual transmission time (r = NL - 


T). Here mp and r are elapsed times. 
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; Figure 7(a). Manual Preparation 





Figure 7(b). JAMPS Preparation 


$< —— 


(time) 
S T NL 
mp cr 


> = Time of Message Stimulus 

T = Time of Message Transmittal 
NL = No-Later-Than Time for Message Transmittal 
mp = Total time to Prepare Message 

r = Residual or Slack Time 


Figure 5.2 Message Preparation Timeline 


Recall we are analyzing a subsystem of a larger tactical 
C2 system. Se ally Process Which is carpered Out quicker in 


this subsystem will mean there is more time for the larger 


system to go through its C2 process. The smaller the value 
ed "hey then the more desirable the subsystem is for the 
message preparation process. And so, we define our measure 


of performance as the ratio: 


To compare how the JAMPS system prepares messages versus the 
manual method, we can use the ratio of the JAMPS MOP to the 


manual preparation MOP: 


MOP( J) 
MOP(M) 


318. 


If Ais less than 1.0, then JAMPS saves time over the manual 
method of preparing messages. If A is greater than 1.0, then 
JAMPS takes more time. If A equals 1.0, then both methods of 
message preparation take the same amount of time. A should 
be less than 1.0. The inverse of A will tell one how much 
faster (or slower) JAMPS is in preparing JINTACCS messages 
then the current method. For example, if A = 0.5, then JAMPS 
takes one-half the time. Using the inverse of A, JAMPS is 


twice as fast. 


E. DISCUSSION AND SUMMARY OF THE MOP 

We developed this MOP using the general guidelines in 
Chapter 6 of the Command and Control Evaluation Workshop. 
One could easily expand the boundaries of the subsystem we 
analyzed and look at a larger system. This is equivalent to 
going from level 1 to level 2 in the hierarchical structure 
of measures. In analyzing the larger C2 system, more dimen- 
Sional parameters and/or subsystem MOPs would be necessary 
im Order Geeereate angen: 

This MOP is best suited for a test in a controlled envi- 
ronment so that one message at a time enters the message 
preparation process. Data collection and analysis would be 
Simple. An exercise environment would be different since a 
JAMPS operator is not likely to get just one message ata 
time to process from beginning to end. More likely, he will 
get several messages, or he will get a second message 
(perhaps with higher precedence) while he is working on his 
first message. In this sPeiationg queuing would occur and 
additional analysis would be needed. 

We used time of message preparation as an MOP because 
time is so important in any command and control system. eg 
the friendly commander can step through his C2 process 
faster then the enemy can execute theirs, then the friendly 
force has a better chance of achieving its objective. The 


shorter the message preparation time, the better the 
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tactical C2 subsystem, considering just this MOP. There are 
many possible MOPs, such as availability, transportability, 
reliability, error rate, and ease of reconfiguration, which 
can affect a C2 system's effectiveness. The expanded anal- 
ysis would be an MOE based on new C2 system boundaries, 
different assumptions, and different objectives. 

One could analyze the C2 system in which information 
flows from the message stimulus, through message prepara- 
tion, to the receiving operational facility's commander. The 
receiving entity could also be similarly modelled as a 
subsystem. The external communications equipment and proce- 
dures would be part of the expanded analysis since they 
affect information flow. Our larger C2 system would then 
involve the two C2 subsystems (message preparation and 
message reception) and their attendant processes, as well as 
the external communications and procedures joining the two. 
A possible MOE for this C2 system could be how the time of 
message preparation influences the receiving commander's 
@eelotmmuiac. percentage of his._resources allocated to 
respond to the received message by a certain time). One 
could even expand this MOE to include how environmental 
factors, such as enemy actions and terrain, influence the C2 
system. 

We have demonstrated just one possible MOP based on our 
objective and assumptions. We have also outlined a possible 
MOE should one carry the analysis further. Our analytical 
approach was at the subsystem level, level 1, but the anal- 


ysis could easily be developed at the system level, level 2. 
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VI. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 

Over the last 10 to 15 years, the U. 5. military has 
become increasingly aware of the importance of command and 
Control in military Weeeracionc. There has been much work 
done concerning the theory behind the C2 process. In his C2 
process model, Dr. Joel S. Lawson, Sr., has stressed the 
criticality of Cimeevoeenc SENSE-PROCESS-COMPARE-DECIDE=~ACT 
(S-P-C=-D-A) process. Relative to a given event, if friendly 
force A can execute its S-P-C-D-A process faster than enemy 
B, then A has a much better chance of defeating B. Operating 
at a higher C2 tempo is a crucial factor in military 
Va CEOry. 

Along with this emphasis on C2 theory, there has been a 
corresponding explosive growth in the development of C2 
systems. One such tactical C2 system is JAMPS. JAMPS is the 
software to automate JINTACCS message standards that the U. 
S. military will use in joint tactical operations. One of 
1ts primary design features is to reduce the time needed to 
prepare joint messages (hard-copy, record traffic). 

Our thesis explored the initial feasibility of inte- 
grating voice recognition with JAMPS. The ultimate goal to 
see if voice recognition could make a JAMPS operator's job 
easier (and therefore reduce work stress) and save even more 
time in preparing messages is left for further research. As 
mentioned in the introduction, we had planned to use the 
Texas Instruments Portable Professional Computer, Wane 
TI-SPEECH installed, as the input device to the current 
prototype JAMPS workstation. When it became possible to 
implement JAMPS directly on the TIPPC, we tabled the prob- 
lems generated with the interface attempt. However, we had 


proceeded far enough to convince ourselves it was possible. 
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Further work could be done to completely interface the TIPPC 
with the JAMPS II.V workstation. But our opinion is that it 
is not worth the time or effort to pursue this since these 
prototypes will not be fielded. 

We used the TIPPC, with TI-SPEECH imbedded, as our auto- 
matic speech recognition system. JAMPS had to be loaded onto 
the TIPPC's hard disk before we could use voice recognition 


to run the software. This enabled us to prove that voice 





recognition can be integrated with JAMPS. Based on our 








research, we strongly believe ASR can make a JAMPS opera- 
tor's job easier and save time in preparing messages. Our 
measure of performance could be used in exercises or 
controlled scenarios to test our hypothesis. Still more 
research is necessary to explore in greater detail the pros 
and cons of ASR with JAMPS. 


B. RECOMMENDED AREAS OF FURTHER RESEARCH 

Our thesis work was a preliminary investigation of using 
ASR with JAMPS. We offer five categories to consider in any 
possible future research. These are areas we think people 
should examine before any final judgement is made concerning 
the use of ASR with JAMPS. This is not an exhaustive list of 
possible research Opie st 

.l.: Refining the Grammar and Operating Procedures 

The grammar we created was a test grammar. We were 

not concerned with optimizing the vocabularies for ease of 
use with JAMPS. A closer study can reveal the appropriate 
phrases and words to incorporate into the vocabularies. 
There must be some optimal way to build vocabularies for 
TI-SPEECH so that an operator can make as few vocabulary 
switches as possible to fill out JAMPS message templates. 
Our thesis indicates that each vocabulary may need certain 
commands for error correction and cursor movement (1. e., 
DELETE, TAB BACK, TAB FORWARD, and DOWN). 
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We built three vocabularies for our grammar and 


generally put similar commands/words in certain vocabu- 


laries. For instance, we placed all alphanumerics in one 
vocabulary and all JAMPS function keys in another. See 
Appendix A for our vocabularies. Someone could definitely 


improve upon our version. Perhaps one large grammar of 450 
words would be better to use instead of 9 vocabularies of 50 
words each. But this is a technical problem--a function of 
Signal processing within voice recognition technology. The 
time for computer recognition and response to voice commands 
would likely increase if there were just one large grammar. 

A final thought to consider for operating procedures 
is keeping track of which vocabulary is active. Sometimes we 
were unsure which vocabulary was active, and therefore we 
lost time in filling out message templates. It was also 
difficult to remember which phrases were in which-vocabu- 
laries, so we had the vocabularies printed out. A small 
display line on the computer video terminal to show the user 
the name of the active vocabulary would be a very helpful 
1eeyen! In any case, our test grammar offers a good starting 
Pointe. 

2. ‘Using ITI-SPEECH in a Zenith 2-150 

JAMPS 1S meant to run on microcomputers. TAFIG and 
MITRE have just upgraded the software so it could run on IBM 
microcomputers or IBM compatibles using MS-DOS as the oper- 
ating system. The TI-SPEECH board is supposed to be IBM 
compatible. Therefore a logical experiment would be to see 
if TI-SPEECH will operate on a Genith Z-150. The 2-150 is a 
desktop microcomputer prevalent in the Air Force and Navy. 
It is TEMPEST cleared and IBM compatible. 

3k TEMPEST and Cost @ensideraceiens 

To our Knowledge, the TIPPC and TI=SPEECH Sarre not 

TEMPEST approved so they may not be appropriate to prepare 


classified messages. This would have to be checked. Also the 
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Cocto avolved in using TI-SPEECH with a TIPPC, a current 
IBM, or an IBM compatible need to be examined before any 
decision is made to use ASR with JAMPS. 
4. Collecting and Analyzing Data for the MOP 
After the ASR grammar has been improved, then 
someone needs to test our MOP to prove or disprove that 
JAMPS with voice recognition saves time over JAMPS with just 
keyboard entry. Data would have to be collected at an exer-" 
cise or under some sort of controlled environment. This 
research would entail experimental design and set-up in 
addition to data analysis. 
52 Investigating Other ASR Systems 
We explained why we chose the TIPPC, with TI-SPEECH 
installed, for use with JAMPS. We had only four ASR systems 
to choose from at the Naval Postgraduate School. But there 
are other ASR systems available for possible interfacing 
with JAMPS. These could be researched along the lines of our 


thesis and recommended research topics. 
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APPENDIX A 
GRAMMAR FOR THE TI-SPEECH SYSTEM 


The grammar we built for the TI-SPEECH is shown below in 
the three different vocabularies. Remember that TI-SPEECH 
allows up to 450 words (9 vocabularies with a maximum of 50 
words each). The left hand column shows the phrase you would 
say; the right hand column is the command that would be 
input into the computer. 

Pronounce the words in the left column as they are 
written. Make sure you always say the words the same way. As 
an example, let's use the phrase "552AWACS", which isa 
military unit. A suggestion in pronouncing this phrase is to 
say it the way you normally do (i.e., "Five fifty second ay 
wax"). Also, when you see spaces between the letters of the 
words/phrases in the left column, sound out each letter 


separately. An example is "TACc." 


* If you use the month of November, there will be a conflict 
between the display of "NOV" and the letter "N." A sugges- 
tion is “to use a different phonetic for "N" (i.e., 
"NICKEL" ). 


VOCABULARY #1 - FUNCTION 


PHRASE 2 60s 5 eye Per ere ere ene omer 
start menu. 5 0 se 
cat select 2.5 5 5 Rm rrm sien ne nnn sImmnes: trite nts tnt cE ge 
COMPOSG@ 5k ke a eee 
enter argument . . 5 2% Ge cleee eee ecemeeege nnn nr enn rou SUetckecs 
help . 2 6 6 6 6 6 eu een 
scroll alternate . . . 4) 2) 5 pe eS cr 
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hectare CLCceme = eee es 4 les. SEO 


MemocnmmrleL@G . . . . % © 6 « « « « « «6 «© «© «© « “<ES> 
Malem KOS). 5 5 6 « 6 ee ee Ss 4 2 2 ro 
DiscuameKDS . 5. se 6 8 8 ee we Uw Oe lw wl lw Uw  6SETOO 
Mewescave Name .....s « « « « « »« « » SCIRE El> 
review message ........+.. «« « « <CTRL FZ> 
neoeeiebemecsage . 1... « . 6 .« «. «ne » “<CTREeE3> 
Dipni message ....: s+... s 6 « « ». SCTRE F4> 
Cemerersation mask .. . . . . s «.... <CTRE ES> 
Wewbicdeace Message . 2. « ss 6 * 8 6 wee <CTRL F6> 
Seve message <9. 2... sw ee el lUl ee 6 CTR > 
Seen oS 6 fk kw Oe eee ee 6 SCTRE BG> 
eulectemsCeiicestyY . 4 . 6 3 ce 6S a Soo SC PREP E> 
Gewletegmessage .. .. ..s 6» «© © »« « « . SCERL F1I0O> 
down... 2... ee ee ee es 6 <DOWN ARROW? 
PROP 2 SS. eee oe «6 SUR ROWe 
CVE 6 9. 4S 4 os. Ue «Yen eee | CROUCH ER RANKOW> - 
Mme es Sle lt es See oe SRE ARROW> 
RO MCMMPPESN eho ces peep hy Ce teen UG. eam ee Cea, pe! SIONS 
ROT ETC pS). 5 v4 Woe. w) epieale Se weoey ae. SAD 
SMC iy) chs * we ne’ tw De). Gua Omen Std > 
CMCC rs co . «feat. «cy (Sud ence te RERUNS 
SOEZOC* LS ne oe re eon he eer aeen <SPACE> 
itsigarimmeriecS . . . : . 4 « . “oMwltCHm TO ALPHANUM-> 
MIP GMmeMIree ., , 5. 292 wo. ee SoWITCH TO JAMPS3> 
ClewmeOmn 5 «ow se) «/ sos) pos eo ee eS DACK SRACE> 
down five . . <DOWN ARROW><DOWN ARROW><DOWN ARROW> 


<DOWN ARROW><DOWN ARROW> 


ial 


VOCABULARY #2 = ALPHANUM 


PHRASE . . 2. 6. «© @ © © 4 6 @ 6 © 6) eminem Los 


zero. 
one 

two 
three 
nmonbie a 
LAs... 
Six 
seven 
eight 
nine . 
alpha 
bravo 
charlie 
delta 
echo . 
fOxXxErOe 
GoLite 
hotel 
india 
juliec . 
Kinkou.: 
Lamar 
mike . 
november . 
oscar 
papa . 
quebec . 
romeo 
Sierra. 


tance 


SO > (i? eum, 2 iene, @ Sees © le @ am | Os V2 9 fe oo ed >= 9 Os Wee) ee Oa We (Oe 3 ey Saas 


uniform 
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VlGtOr.. 
whiskey 

x ray 
yankee . 
Zune. 
delete . 
jamps three 
return . 
space 

cat select . 
down . 
compose 
function keys 
slant bar 
dash . 

tab back . 


v3 


NK Sw 2 SG 


<BACK SPACE> 

<SWITCH TO JAMPS3> 
<RETURN> 

<SPACE> 

<F2> 

<DOWN ARROW> 

<F3> 

SOW eh Lose UNeT!ON> 
Vi 


<SHF TAB> 


VOCABULARY #3 - JAMPS3 


PHRASE . « «6 se 8 ee ee ee eon ein Ig op eyes 


unclassified . . . .6 .« . « © © «© © » «© « yee GiiierS 
confiidentialum. .... . CONE 1 Dalia Dawe 
SOG. « « « « “« Ge) Eee ec. 25) cee > ESGeReE T 
@EEOQ.. 5 6 se ee em se eT 
airlift. «© 6 8 ee ee ell lw we ee ete] 
aerials refueling . .. 3s £4. 4. © + . 3° ee ee 
Glose air support (or CAS) . ... . . . . eee 
combat air patsele(or CAP) ... . . . eee 
reconnaissance (or RECCE) . .., . « «: Sere 
19th Air Refueling Wing .... . ... . ILSARBEW 
33rd Tactical Fighter Wing... .... . . J3SiREW 
37th Tactical Fighter Wing .. 5 =>. « « 2 woman 
5S2nd AWACS . . .s « «= 5 « @ eS. & «.. « SSZ ee 
Commander JTF ............ . . COMJTF 
oe a Onn On eee ee rr. = 5 jy eee a JUN SS 
NOVEM = sk ae. a an Se eee ee 
SOUtCH ck we a ira eee oc ce 
east ©. 2 «© B 8 ew oe GE 2 ee ee ee E 
west. 3. «6 6s 8) 6 be 
January «© 2. © 6 © Ho & = oe eee Oe 
February «6 bee ee es ars 
march . «© 8 %3 9. 6 se 2 Ree er ee 
vo i-t_) o PPPS 6059 2 5 tog eg ec 
SDAC@ 5 ee weer ee ee mnt <SPACE> 
DAaSED 6 «© 6 © ww oe ee eee re) Bente nnn PASEP 
motal . 6 © 6 oe eh ce Seeger enernnnne ner one! elie ve 
bold eagle 85 ... 2. « @ 4S GoD OLD = eA CEwae. 
umpires only . 1. . «© « s « 4 = Soe peeOD ees ome rien 
alphanumerics ... .« » « »« « “owl lGHeteGe Pena wii 
delete . . « « «© «© «© © @ % © & cf uemesnnietine IID es O3) cum e ites 
return . . 2. «© «© © © © © es eee ese 
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function keys ...... . . <SWITCH TO FUNCTION> 
GC ki -soeeeth. cee. ee . 2 2 ee CALLANT KNIGHT-86 
cololel a . < -r . . . . . coher TAB> 


iis 


The 
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APPENDIX C€ 
USER'S GUIDE FOR USING TI-SPEECH 


This user's guide will provide the basic guidelines and 
commands an individual will need to bring up the TI-SPEECH 
on the TI Portable Professional Computer and use it as an 
input device for his computer. We will operate a basic 
TIPPC system with all the hardware and software (described 
in Chapter 4) installed. If the software has not been 
installed, the user will have to refer to the appropriate 
manuals for the necessary procedures. 

Chapter 4 addressed several guidelines to follow when 
implementing the speech recognition system. Keep these 
guidelines in mind as you use the system. Texas 
Instruments’ guidance is that once the voiceprints have been 
created, the user should test his vocabulary and then refine 
those voiceprints in which the matches were low or poor 
(less than a match value of 5). We had greater success in 
recognition when we refined all the voiceprints before 
executing the test option. We used three passes during 
refinement. Further study should determine the optimal 
number of refinement passes to achieve the best possible 
recognition 

Following each explanatory paragraph are the commands or 
instructions to execute the necessary procedures. When you 
see the command <RETURN>, it means to press the RETURN key 
on the lower right portion of the main keyboard area. 
<ENTER> means to press the ENTER Key on the lower right hand 
Side of the numeric keypad. <Enn> indicates the function 
key corresponding to the number, nn, is to be pressed. 
Commands inside the quotation marks are commands the oper- 


ator must enter from the keyboard. Do not enter the quotes. 
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Cursor instructions will also appear inside brackets with 
the command segment to be selected in single quotation 


marks. A sample command would look like this: 
"EMULATE" <RETURN> 


This means the operator should type the word, emulate, and 
then press the RETURN key to execute the command. A sample 


i’seruction would look like this: 
<MOVE CURSOR TO 'ADD AN ENTRY'> <RETURN> 


This instruction means the operator should use the cursor to 
highlight the segment "ADD AN ENTRY" and then press’ the 
RETURN key. 

When in the Vocabulary Manager, the user should remember 
the RETURN Key is used to select a command segment and build 
a command for execution. Once the command is built, press 
the ENTER key to execute the command. There are many 
instances in which the RETURN key will result in a command 
being executed. The user will need to be alert to the 
prompts in this guide and those provided by TI. 

At every point TI has provided a help function for the 
user. Molmecdtieread It by pressing the appropriate LZunction 
key as shown in the function Key area of each menu. The 
help function provides additional information on the command 
segment that is highlighted at the time. This information 
can clear up many questions a user may have during use of 
the VM. You can use the help function any time without 


losing your place in the VM. 


Steps to Enter the Vocabulary Manager. 


1) Turn on the computer. The power switch is located on 
the top center of the TIPPC near the back edge. 





2) The computer will perform a_ series of Bote aeP self 


checks and display some routine messages. Fina ¥ the 
system will show_a date and ask the user to input the 
current date. Enter the date using all numbers. For 


example, you would enter March 8, 1986, as 3-8-86. Or 


eal 


the user can simply bypass the date by pressing the 


RETURN key 
<RETURN> 

3) Next_the system will ask for the correct time. You 
should enter time using the 24 hour clock. Two 


o'clock in the afternoon would be entered as 14:00. As 
with the date the user can bypass the time simply by 
pressing the RETURN Key. 


<RETURN> 

4) The system will now automatically execute a series of 
commands and oe up the Naturallank. program The 
user will see a aturalLink introductory screen and 
then the rimary NaturalLink menu. TNee Ulises lionel 
now use the function key to exit the NaturalLink 
program. 
SZ 

5) The user will now see the DOS prompt, E>. This .agida= 


cates the default drive is the Winchester hard disk. 
This means the computer will look for the executable 
programs on the ard di sivas Whenever the prompt 
appears, the computer 1s waiting for the next command. 
Farst the user must CiMrCr == ehewepecen “Subd recerew 
This is where the Vocabulary Manager and entered voca- 
bularies reside. Note the reverse slash stroke in the 


command. 
"CD \TISPEECH" <RETURN> 
6) Next the device service routines (DSky) must be 


installed as discussed in Chapgeecuaee. 9) 2nis 1S aenme. es 
pee TISPEECH and pressing the RETURN key. While 
the routines are being installed, a message will 
appear. When the DOS prompt reappears, go on to step 
seven (7). 

"TISPEECH" <RETURN> 


7) At last the user is ready to activate the Vocabulary 
Manager. Type in VM and hit the RETURN key. 


"VM" <RETURN> 

8) The user will now see the Vocabulary meneder logo. At 
this point the VM asks Che User ere@emeer his Nalen ee, 
entering his Mame the User establvsehes tae sulbcmrecs 
tory in which His vorceprints iyi eee cor ca: 


<ENTER YOUR NAME> <RETURN> 


steps for Entering/Training a New Vocabulary 


The user will now see the Vocabulary Manager's main 
menu. Using this menu the user will be able to execute all 
of the VM @runcemens, To enter and train a new vocabulary 
for use, follow these steps: 


1) Note on the main menu the first item in the command 
section is highlighted. This item is "set up. and 
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2) 


3) 


4) 


>) 


6) 


7) 


8) 


basen ayvyocabulary". Select this “tem using” ‘the 
RETURN Key. 


<RETURN> 


Now he highlight has meved to the first item _in the 
vocabulary lis meee eee the cursor control keys, 
move the highlight until the “<other vocabulary> is 
highlighted and select this segment with the RETURN 
dp You can also hit the HOME key, which is in the 
middle of the five cursor-key cluster, to bring you to 

<other vocabulary>," which is at the bottom of the 
vocabulary listing). 


<MOVE CURSOR TO '<OTHER VOCABULARY>'> <RETURN> 

Now a pop-up window will pepear asking for the name of 
this vocabulary. Enter e name chosen for the new 
vocabulary and press the RETURN Key. 

<ENTER VOCABULARY NAME> <RETURN> 

Note the command has now been completed and appears in 


the command window. The user is prompted to press the 
run( ENTER) key to execute the command. 


<ENTER> 
Ghis brings pe a Revie ni rol seme Use. Panes 2s cle 
set up and train" menu and is used in the creation 


and training of new vocabularies or the training o 


already entéred vocabularies. The item "add an en = 
is highlighted; select this item by pressing the 
RETURN Key. ; 

<RETURN> 


A pop-up window will appear prompting the user to 
enter the phrase for the command he wants to execute. 
Enter the phrase and press the RETURN Key. 


<PHRASE> <RETURN> 


A second pope-e Window will appear ge bead ee the user 
to input the keystrokes port cs oneLnd 15o, he phrase 
and command to be executed. The user should keep in 
mind that each key pressed will appear in the pop-up 


window. if an error is made it will be necessary to 
use the wee Rey S EUOEE command after the entire 
set of keystrokes has been entered. Once the user 


enters the keystrokes, he will have to press and hold 
the CONTR@EL (CTRigs key (foundeat the lett side of the 
main keyboard area) and press the RETURN key at the 
same time to indicate he has completed entry of the 
keystrokes. 


<ENTER KEYSTROKES> 
<CTRL> <RETURN> simultaneously 


litte etl l complete Behewentry =of both phrase and 
keystrokes. Note the “set up and - train vocabulary" 
menu has returned with the “add an entry" item high- 
Lreihiced, The user snoula comtinue Co execute steps 
fiom oe SlxX (6), sand. seven wee until he has entered 
his entire vocabu ae When this has been completed, 
Genome cO Step nine (9%). 


SS 


9) 


10) 


sll) 


Zz) 


13) 


14) 


15) 


16) 


de) 


i3;) 


Use the cursor control keys to ee the "create 
voiceprints" command and press the RETURN key. 


<MOVE CURSOR TO 'CREATE VOICEPRINTS'> <RETURN> 


A pop-up window, _wijl appear with three options. The 
option “all of them" is already highlighted. Press the 
RETURN Key. 


<RETURN> 


The user will be Premeces to insure the input device 
is turned on. When the user is ready to begin, he 
should press the RETURN keV The computer now prompts 
YOUREO say each word as it appears in another pop-up 
window. 


<RETURN> 


When the user has created his voiceprints, he should 
refine them. Mevemieme ee EN to the "refine voice- 
prints” item and press the RETURN key. 


<MOVE CURSOR TO 'REFINE VOICEPRINTS'> <RETURN> 
A pop-up window will Soke asking the user which 


voiceprints he wishes o refine. The user should 
select the option "all of them. " 


<RETURN> 
A. window will now appear asking the user how many 
times he wishes to refine each voiceprint. The user 


ee enter the number three (3) and press the RETURN 
ey. 


"3" <RETURN> 


The user is now prompted to insure the input device is 
turned on andy! ace, When the user is ready to 
execute the refinement process, he should press the 
RETURN key. 


<RETURN> 

The user wall now be pyemeccam ee = puamenc hrase three 
times. The number tnerements@eceim@acime thee pmnase I> 
recognized. When you have said the phrase three 
times, the next phrase will appear for refinement 
until the entire vocabulary has been refined. 

When | the reftinemena ile weconp leu the "set up. and 
train" menu will once again appear The user should 
now highlight and select e ‘test voiceprints" 


command. 
<MOVE CURSOR TO 'TEST VOICEPRINTS'> <RETURN> 


All of the phrases will appear on the screen behind a 
pop-up window which prompts the user to insure the 
input device is activated. ° When he is ready to begin 
the test, the user should precs@encger SUR ce. ac 
ee Shabee is spoken until the entire vocabulary has been 

ested. The user will see the match window, discussed 
on page 53 in Chapter 4, for each phrase spoken. 


<RETURN> 
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19) 


20) 


Once the user completes the test, he should press the 
ENTER key. 


<ENTER> 


If the user was not satisfied with all_the matches he 
achieved, he can refine those particular voiceprints 
using the "refine voiceprints"” command. If the user 
;S satisfied, he should press the F10 key to exit the 

set up and train" mode and return to the main menu. 
The user must insure he saves his voiceprints by 
pressing the RETURN key when asked. 


<RETURN><F10> or <CURSOR ‘REFINE VOICEPRINTS' ><RETURN> 


summary of Steps for YM Commands 


A general summary of the steps above is provided here 


for the user's benefit. These steps draw together the main 


sequence of actions when entering and training a new vocabu- 


lary 


1) 
2) 
3) 
4) 
>) 
6) 
7) 
8) 


Select the "set up and train" command. 

Enter the new vocabulary name. 

Add each new entry. 

Create the voiceprints for the new vocabulary. 
refine each voiceprint three times. 

Test your voiceprints to determine level of match. 
Refine any voiceprints you feel are not adequate. 


Exit the "set up and train" menu. Be sure to save 
your voiceprints when prompted. 


lraining an Already-Created Vocabulary 
To train a vocabulary that has already been entered, the 


user should use the following steps. The main menu should be 


displayed. 


1) 


2) 


3) 


ees the item "set up and train a vocabulary" and 
press the RETURN key. 


<CURSOR TO ‘SET UP AND TRAIN VOCABULARY'> <RETURN> 
Note the highlight has now moved to the vocabulary 
ee Using the cursor control Keys, ee the 
name or the vocabulary you want to train. elect this 
vocabulary by pressing the RETURN key. 

<SELECT VOCABULARY NAME> <RETURN> 


The vocabulary will appear in the command window and 
the user will be prompted to press the run( ENTERS key. 


<ENTER> 
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4) The "set up and train" menu will now appear. The user 
should execute the steps outlined in the previous 
section starting with step nine (9 


Adding a Voice=-Activated Vocabulary Switch 

As discussed in Chapter 4, there are two methods of 
switching from one vocabulary to another vocabulary 
(changing the active vocabulary). This can be done by using 
the main menu or having the computer execute the change with 
a voice command. We considered using a voice activated 
Switch to be faster. To execute a voice activated switch, 
an appropriate phrase and keystrokes must first be entered. 
To do this the user should follow these steps: 


1) The user should perform steps one (1) and two (2 of 
the section on Sibe, ing) eed a new, vocabulary. 
Instead of selecting "<ofher vocabulary>" in step two 

Z2),. select the name of the vocabulary that needs the 
vocabulary switch added. 


2) When the "set up and train menu" appears, execute 
steps five (5) through seven (7) in _ the entema 
training a new vocabulary section. the phrase to be 
entered is the phrase that, when spoken, will cause 
the computer to execute the switch. We used the name 
of the vocabulary we wWaneced) Yemsymeccn Co as OCU seme ace 
(i. e., switch word). The keystrokes at this point 
are optional. If you want the computer to execute 
some command before it makes the switch, then 
keystrokes should be entered. If you_only want the 
computer to change the active vocabulary, then no 
keystrokes need to be entered. 


3) You will now_ have entered the switch hrase and 
keystrokes, if desired. The “set up and train" menu 
Should now be displayed. . _ Using the cursor control 
ee highlight the Huse keystrokes" command and 
select it by pressing the RETURN Key. 


<MOVE CURSOR TO 'MODIFY KEYSTROKES'> <RETURN> 

4) The vocabulary will appear. Using the curser contre 
st au Jqakedguikalepane  elgi= yocae ta switch you have just 
entered and select it with the RETURN Key. 
<MOVE CURSOR TO THE APPROPRIATE ENTRY> <RETURN> 

5) A new menu, ete ey keystrokes", will now appear. 
Using the cursor control (~Kkeyst sirgiee jhe jenencommanme 
"add a vocabulary switch" and select it by pressing 
the RETURN key. 
<MOVE CURSOR TO 'ADD A VOCABULARY SWITCH'> <RETURN> 


6) All the available vocabularies will now appear ina 
Pee window. Two other entries are. also available. 


ise iS tne _ BeSTeeus et ae Use of this 
choice will take the user back to the vocabulary Chat 
was active immediately before the one now active. The 
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S6ther cHoice is "<other vocabulary>. This lets the 
user enter the name of a vocabulary that he plans to 
enter. select the vocabulary name or command that is 
desired and press the RETURN Key. 


<MOVE CURSOR TO APPROPRIATE CHOICE> <RETURN> 
7) The user has now completed the entry of the vocabulary 


Switch and should press the F1lO key to exit the 
i} : tt Y 
modify keystrokes" menu. 


<F1O> 
6) ime user will now see the ‘set up and train vocabu- 
lary. 10m sheuld now perfomm stéps 9 through 2O of 


the section, entering/training a_ new vocabulary, to 
ieee 2ekdg fos Vercce eats: Make sure the vocabu- 

As you insert switch words into a vocabulary, make sure 
there is a command for each vocabulary that you might wish 
Go linkeeogether. If you are planning to use nine vocabu- 
Taoares at oWemclmems then consider putting a switehm@word for 
each additional vocabulary in one master vocabulary. One 
switch word in each of the eight additional vocabularies is 
all that will be necessary to return to the master vocabu- 
lary and then to another vocabulary. This way valuable 
vocabulary space is not taken up by a large number of switch 


phrases. 


Starting VomeewRecogni tion 

Once all the appropriate vocabularies have been entered 
and trained, the user is ready to turn on the voice recogni- 
tion and implement the chosen application accordingly. ike. 
Smee thesyorce recognition, follow these steps: 

1) The main menu should be displayed. Using ene. cursor 
6omemellkeys, highlight .the "start recognition of 
vocabulary" and hit the RETURN key. 
<CURSOR TO 'START RECOGNITION OF VOCABULARY'> <RETURN> 

me These tirst item in the Veer ow Pmestimeg 15  high= 
lighted. Using the cursor control keys, move through 
the list and highlight the desired vocabulary. Press 
the RETURN key. 
<SELECT DESIRED VOCABULARY> <RETURN> 

3) I£ the user has oe one vocabulary to use he should 
now skip to. ste ; f the user wishes to link 


Se veus* vocabularies together, then follow the next 
steps. 
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4) Once the first vocabulary is ‘sellectecay eae U-cens 
note another segment becemes avallable go Seeneaocen, 
The selection "an vocabulary," is highlighted 
already. Hit the RETURN key. 


<RETURN> 
5) After you select the "and vocabulary" segment, the 
first item ain the Vecabulary [estang Gevences again 
highlighted. Using the eursor Gentrolerey teh light 
cee next vocabulary to be used and press the RETURN 
ey. 
<SELECT NEXT VOCABULARY> <RETURN> 


6) The user will now note the "and vocabulary" has again 


been highlighted. An additional choice has appeared, 
This is the @ set the first active) |Vcceabimiew,, Jto. 
segment. If the the user wishes to link more vocabu- 


five (5) above until all have been selected. emember 
the maximum number that can linked is nine (9) Once 
all the vocabularies have been selectedeyoum muses 
the active Nadet ele Es This is the vocabulary which 
the ASR system will first recognize when enabled. To 


laries together, he should ad AS steps four ey and 


do this, select the "set first active vocabulary to" 
Secmene with the cursor control and press the RETURN 
ey. 


<SELECT 'SET FIRST ACTIVE VOCABULARY TO'> <RETURN> 


7) When you choose the "set first active vocabulary to" 
segment, all the previously selected vocabularies will 
appear in a pop-up window. The user should select the 
vocabulary .he wishes to be active with the cursor 
control key and press the RETURN Key. 


<SELECT DESIRED ACTIVE VOCABULARY> <RETURN> 


8) The command has now been completed and is ready for 
excelled. When the User Slomeecac, mes SHOUEMGL Davee 
the ENTER key. fhe system wae blank the screen and a 
brief message will appear while the vocabularies are 
loaded into memory. 


<ENTER> 
9) When all the vocabularies are in memory and the ASR 


system is activated, the main VM menu will be redis- 
ayed. The user should exit VM by pressing the F110 


ey. 
<F1O> 
10) The DOS prompt (E>) will appear indicating the system 


is ready to implement the desired application using 
voice or keyboard input. 


Using Voice Recognition With JAMPsS 
This thesis has been concerned with the application of 
voice recognition to the JAMPS II.V. The JAMPS software, in 


aversion usable by the TIPPC, now resides on one of the 
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TIPPC's Winchester hard disk. This software uses over five 
megabytes of memory. To use voice input with the JAMPS 
software, follow these steps: 


1) The vocabularies we designed for use with JAMPS are 
Called ALPHANUM, FUNCTION, and JAMPS3. You will find 
EHeweGOmcents Of each vocabulary in Appendix A. The 
user must first create his voiceprints for these voca- 
bularies by Shad pape | the steps listed in the above 
section, Training an Already-Created Vocabulary. 


2) Once you have created the voiceprints, you must 
execute the steps in the Startin Piome Ge Neco an C1 On 
section. It does not matter which vocabulary the user 
sets as active first. That choice can be better made 
after the user has gained some experience in using 


JAMPS. 
3) When the DOS rompt po) ad the user must tell the 
TIPPC to emulate an I Personal Computer. Do so by 


executing the EMULATE pLogoe available in the oper- 


ating system rovided by This program must be 


executed for JAMPS to run on the TIPPC. 
"EMULATE" <RETURN> 


4) A message will appear telling the user the emulator 


has been run. Then the DOS prompt will be displayed. 
Tiem@ice@eiitice now enter the subdirectories where the 
JAMPS programs reside. This is done by entering the 


following command. Note the reverse slashes. 
"CD \OEDNJAMPS" <RETURN> 
5) The DOS prompt will again appear. This, time enter 
JAMPS and press the RETURN key. Paice. Dein, Up 
the initial JAMPS menu, as seen on page 21 in Chapter 
_ JAMPS 1s now available and ready for user manipula- 
tion using either voice or keyboard input. 


"JAMPS" <RETURN> 


Guidelines for Filling ina JAMPS Message Template with 
VYouce Recooqni Gi0on 
These are guidelines for manipulating a JAMPS message 





template with voice input commands. As an example, we will 
use the B704 mask mode template, as shown in Figure 2.3 You 
will find the vocabularies of available words for input in 
Appendix A. Please note that this is not a complete listing 
of all commands or input words to use with JAMPS. We will 
cover afew of the input commands in our grammar. For 
complete information on all JAMPS commands, see the JAMPS 


II.Y Operator's Manual. 
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Each paragraph will explain the sequence of voice 


commands for input. Following the paragraph will be the 


appropriate voice commands. Voice commands will appear in 


quotation marks. 


1) 


2) 


3) 


4) 


>) 


G ) 


Ensure the ALPHANUM vocabulary is active and the 
other wor vocabularies. JAMPS3 and FUNCTION, ale 
available. If @syou Mave  ~cemptetece™ene Steps in ene 
Roce Aoner section, then ou should see the initial 
AMPS main. menu. Select the sabanpber ee aS OPERATIONS, 


by saying "2." @hen switch Seemties: TION vocabulary 
by aa "EUNCTION KEYS." Execute your selection by 
saying "CAT SELECT. 


"2" “FUNCTION KEYS “CAT VSERE@ ie 


You will now_see the listing of AIR OPERATIONS message 
templates. Switch back to the ALPHANUM vocabulary by 
e052 "ALPHANUMERICS." Next say the message number, 
B704. Switch back to the FUNCTION vocabulary and 
compose the message. 


"ALPHANUMERICS" "B704" "FUNCTION KEYS" "COMPOSE" 


You will see the cursor located in the first data set 
on the first line. Addressing information from a 
Pay toe JAMPS demonstration is araens placecemin che 

eading pores en of the message. Move, the cursor down 
to the XER/EXERNICK set by saying "DOWN FIVE’ 
times and "DOWN" three times. 


"DOWN FIVE" "DOWN FIVE" "DOWN" "DOWN" "DOWN" 


Say "TAB FORWARD" to move the cursor to the beginning 
of the empty data field. Note that the blanks in the 
data field convert to map chanaccters, which are 
discussed in Chapter 2._ Change _to the JAMPS3 vocabu- 
lary ee saying "“JAMPS THREE. Enter "BOLD EAGLE 85" 
into the field, then say "RETURN. " 


"TAB FORWARD" "JAMPS THREE" "BOLD EAGLE 85" "RETURN" 


The user should continue to input Gnftormation into Che 
empty data fields in a similar manner by using the 
appropriate phrases and switch weras from Be eC jee 
UGE well See aaa pcre pce status Dame at e bot com 
of the screen at all times. This status line tells you 
the minimum and maximum number of characters for that 
field and whether or not the field is mandatory. 


Cwo 


If at any time you do not know what information is 
required 1h a field, ou can enter the HELP mode. 
chen ler ou. are in the FUNCTION vecabulary ~betore 
saying "HELP." As we api SS stated in Chapter 2, the 
user Can also enter the §eONViRSA Olas snece aad 
order to fill oug data Bields’ | ingtels Mode cue a 
fill out each data field gwith the atewot SIELP ccreene: 
A HELP screen gives you the field Yow ame, locarcedyam 
the allowable data entries for that field, and a defi- 
nition of the field. After you enter the data for the 
field and say "RETURN," JAMPS will display for you the 
next available field in a HELP fUne@eien Scere eu 
ma continue to fill out the entire message in 
CONVERSATION MASK mode. 
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7) You should remember that our grammar is not ebcele 
enough to complete the entire message. However, the 
grammar is sufficient to demonstrate the feasibilit 
of using voice recognition as an input mode to JAMPS. 


8) Once you have filled out the message template, ou 
have several options on what to do next. The FUNCTION 
vocabulary has the phrases to review, PEdne save, 


Validate, delete, or transmit the pageant Refer to 
the JAMPS II1.Y Operator s Manual for a ull explana- 
tion of these functions. 


ay tere GXit JAMPS, ensure the FUNCTION vocabulary is 
active. Say "START MENU," and you will get the orig- 
inal JAMPS main menu. Due to_ shortcomings in_ the 
interface between the JAMPS software and- the TIPPC, 
there is no graceful way to exit JAMPS. Entering HA, 
ees), “whl Mot work off of the mali menu. 
Therefore, you must reboot the system by pressing the 


Cite ALT, and DEL keys simultaneously. Paes W111 
joban eke; Gla Daciie CO cCompuicer Sveeem start-up, as 
outlined in the first section of this appendix. 


"FUNCTION KEYS" "START MENU" 
<CTRL> <ALT> <DEL> simultaneously 


In this user's guide we provided the basic guidelines 
for using the TI-SPEECH Vocabulary Manager and JAMPS. More 
detailed instructions for the VM commands we provided are in 
the TI-SPEECH Yocabulary Manager Guide. You will also find 


instructions on additional VM commands available in this 





same reference. For information on using the JAMPS software, 


refer to the JAMPS II.V Operator's Manual. 
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